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Preface 


The  purpose  of  this  research  was  to  discover  and  record  the  heuristics 
used  by  hospital  inventory  management  experts.  An  expert  system  was 
developed  to  verify  the  captured  knowledge  and  the  system  is  now  being 
used  by  the  Wright- Patterson  AFB  Medical  Logistics  Branch. 

The  methodology  was  chosen  for  the  simplicity  of  developing  an  expert 
system.  Though  the  methodology  is  aimed  towards  developing  an  expert 
system,  it  is  an  outstanding  method  for  obtaining  information  from  experts. 

An  underlying  point  of  this  research  is  that  the  knowledge  extracted  from 
experts  for  use  in  computer  programs  must  be  made  readily  accessible  to  the 
end  user  of  the  program.  To  this  end,  I  hope  this  research  ensures  the 
knowledge  will  not  be  lost  and  demonstrates  the  power  of  expert  systems. 

1  had  a  great  deal  of  help  in  performing  this  research  and  writing  of 
this  thesis.  I  am  indebted  to  my  thesis  advisor.  Lieutenant  Commander  Don 
McNeeley,  for  his  lasting  patience  and  assistance.  My  sincere  appreciation 
goes  to  Captain  Lois  Schloz  for  proofing  my  grammar.  I  also  wish  to  thank 
Captain  John  Hill  of  the  WPAFB  Medical  Logistics  Branch  for  suggesting 
the  topic  and  a  special  thanks  go  to  Senior  Master  Sergeant  Donovant, 

Master  Sergeant  Spain  and  Staff  Sergeant  Howard  for  serving  as  experts, 
making  hours  of  decisions  on  data  sets  and  helping  solve  computer 
programming  problems.  Finally,  I  wish  to  thank  my  wife  Terri  for  her 
understanding  and  support  while  I  was  busy  working  on  my  computer  to 
complete  this  effort. 

Thomas  G.  Hibson 
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AFIT/GLM/LSM/91S-29 

AbStRfii 

This  study  investigated  the  reasoning  strategies  used  by  hospital 
logistics  management  experts  and  was  conducted  at  the  Wright-Patterson 
AFB  (WPAFB)  Medical  Center.  An  expert  system  was  developed  to  verify 
the  captured  strategies.  The  particular  area  of  interest  of  this  study  was 
the  reasoning  strategies  involved  in  the  reconciliation  of  the  Monthly  Stock 
Status  Report  within  the  Medical  Logistics  Branch.  A  literature  review 
revealed  there  were  few  guidelines  as  to  when  and  what  action  to  pursue 
when  reconciling  the  Monthly  Stock  Status  Report.  Though  there  were  no 
references  in  the  literature  on  expert  systems  that  dealt  with  this  particular 
report,  there  were  many  references  to  the  development  of  such  an  expert 
system.  The  research  was  done  in  three  phases.  The  first  phase  was 
knowledge  acquisition  which  is  when  the  researcher  interviewed  the 
expert  and  did  the  initial  formulation  of  the  reasoning  strategy.  During  the 
second  phase,  the  researcher  developed  an  expert  system  which  was  then 
validated  in  the  third  phase.  The  validation  revealed  the  expert  system  made 
the  same  decision  as  the  human  expert  over  98%  of  the  time  in  the  validation 
data  sets.  It  was  therefore  concluded  the  reasoning  strategies  were 
captured.  The  WPAFB  medical  logistics  personnel  readily  accepted  the 
expert  system  and  recommendations  for  further  testing  of  this  expert  system 
and  possible  applications  for  new  expert  systems  are  provided. 
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Heuristics  for  Hospital  Inventory  Management 


I.  Introduction 


Overview 

Effective  decision-making  is  an  important  part  of  any  manager’s  job. 
Often  faced  with  uncertainty,  pressure,  and  poor  information,  managers 
must  make  consistent,  reliable,  and  timely  decisions.  In  his  book  Putting 
Artificial  Intelligence  la  Work.  Schoen  offers  a  diagram  depicting  the 
manager's  decision  environment  (Figure  1).  It  is  a  rare  occurrence  when 
managers  have  enough  time  or  information  to  make  a  perfect  decision.  This 
forces  managers  to  make  acceptable  decisions,  but  not  necessarily  optimal, 
decisions.  Although  the  decision  may  not  be  optimal  it  must  still  solve  the 
problem  using  the  resources  within  the  manager's  control. 

Inventory  managers  are  subject  to  this  same  decision-making 
environment,  and  are  tasked  with  the  added  responsibility  of  ensuring 
operating  inventories  contain  the  right  items  in  the  correct  quantities.  This 
responsibility  is  an  integral  aspect  of  monitoring  inventories.  Unneeded 
items  and  overstocked  items  waste  money  since  procuring,  storing,  and 
accounting  for  these  unneeded  items  require  time,  space  and  money  which 
could  have  been  used  on  more  critical  assets.  Not  having  the  right  items  or 
stocking  an  insufficient  number  of  critical  items  incurs  the  cost  of  only 
partly  meeting  the  mission  or  possibly  not  meeting  the  mission  at  all. 

Another  complex  issue  is  determining  inventory  requirements  for  mission 
effectiveness  in  a  continuously  changing  world.  The  world  is  not  static,  and 
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as  the  operational  environment  changes,  the  material  needed  to  complete  the 
mission  requirements  can  change  quickly  and  drastically.  Operating 
inventories  must  quickly  reflect  these  environmental  changes  to  ensure 
adequate  mission  support. 


Decision  Parametef 


Decision  Reamrements 


Information;  Incomplete 
Inconsistent 
Subjective 


Pressure 


Uncertainty  ■ 
Environment 


Limitations 


Impacts 


Acceptable  Decision 

•  Timely 

•  Relevant 

•  Reliable 

•  Satisfactory 
(Not  necessarily 

optimum) 


Figure  1.  Manager's  Decision  Environment  (20:1S) 

Defense  Department  Logistics  Environment 

The  decision  environment  described  above  also  permeates  the  Defense 
Department  but  the  pressure  is  compounded  by  the  past  practices  of 
inventory  managers  and  the  present  government  policies  of  budget  and  total 
force  reduction  Since  197-4,  the  General  Accounting  Office  (GAOt 
conducted  at  least  21  audits,  which  revealed  problems  of  overstocking  in  all 
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sectors  of  the  Department  of  Defense.  Some  reasons  for  this  are  the  failure 
to  cancel  excess  stocks  on  order,  keeping  unneeded  parts,  and  a  lack  of 
management  controls  (2:61).  The  Air  Force  Logistics  Command  (AFLC) 
responded  to  these  charges  by  saying  the  stocks  were  insurance  against  not- 
mission-capable  situations,  which  is  when  a  lack  of  parts  makes  weapon 
systems  unavailable  for  their  intended  use  (2:63). 

Senior  military  logistics  officials  are  aware  of  the  lengthening  lead 
times  for  the  procurement  of  assets,  which  is  another  contributor  to 
overstocking  (2:63).  The  primary  cause  of  the  lengthening  lead  times  is  the 
congressional  push  for  increased  competition  among  the  suppliers  of  assets. 
Increased  competition  increases  the  time  before  a  contract  is  awarded, 
which  increases  the  lead  times  for  stock  replenishment  resulting  in  the  need 
for  larger  inventories  (3:16). 

Longer  lead  times  are  not  the  only  problem  faced  by  DOD  inventory 
managers.  The  sheer  size  and  complexity  of  many  DOD  inventories  causes 
severe  inventory  management  problems.  Charles  Bowsher.  comptroller 
general  for  GAO.  testifying  on  the  DOD  inventory  system  before  the  Senate 
Committee  on  Governmental  Affairs  in  October  1987,  said  "there  was  no 
comparable  supply  system  anywhere”  (3:16).  The  DOD  inventory  system 
contains  over  4.5  million  parts  and  the  Air  Force  alone  has  over  18  million 
square  feet  of  warehouses  (approximately  43.7  Astrodomes)  (3:16-17). 
Bowsher  continued; 

While  the  sheer  magnitude  makes  it  a  challenge  to  manage,  the 
magnitude  makes  it  imperative  to  have  good  management  to  promote 
efficient  and  effective  operations,  support  military  missions  and 
protect  the  inventories  from  fraud  waste  and  abuse.  (3:16) 
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The  inventory  of  the  Wright- Patterson  Air  Force  Base  (WPAFB) 
Medical  Logistics  Management  Branch  is  one  of  the  largest  medical  supply 
inventories  in  the  Air  Force.  Because  of  the  inventory  account  size,  the 
dynamics  of  the  account,  and  the  reliance  on  experienced  people  to  manage 
the  account,  the  WPAFB  Medical  Logistics  Management  Branch  is 
encountering  many  of  the  inventory  management  problems  discussed  earlier. 

Presently,  there  are  about  7,000  line  items  in  the  account,  which  are 
managed  using  limited  automated  detection  of  inventory  management 
problems.  A  senior  Noncommissioned  Officer  (NCO)  currently  spends 
nearly  25  hours  per  month  reviewing  the  Monthly  Stock  Status  Report. 
which  identifies  potential  problems  and  deciding  on  corrective  actions. 

Refer  to  appendix  A  for  a  copy  of  an  annotated  page  from  a  Monthly  Stock 
Status  Report.  Hospital  inventory  management  personnel  then  perform  the 
corrective  actions  and  update  the  computer  records.  If  this  process  is 
delayed,  it  is  finished  just  before  the  next  month’s  Monthly  Stock  Status 
Reoo.’t  is  produced  which  could  increase  the  number  and  complexity  of 
inventory  problems. 

The  WPAFB  medical  logistics  inventory  account  is  not  only  large,  but 
is  also  very  dynamic.  When  new  doctors  arrive,  they  requisition  equipment 
and  supplies  they  are  familiar  with,  but  which  may  not  already  exist  in  the 
logistics  system.  Items  are  also  added  to  the  logistics  system  when  a  new 
procedure  is  implemented  and  the  required  support  materials  are  not  in  the 
medical  logistics  inventory  system.  Therefore,  the  inventory  can  have  items 
which  have  very  little  demand  history  data.  The  reverse  of  this  situation 
also  happens.  As  doctors  leave  and  old  procedures  are  abandoned,  many 
items  remain  in  the  inventory  which  will  have  few  future  demands  placed 
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on  them.  The  detection  of  these  situations  are  compounded  by  the  stockage 
of  low  use  items  which  are  essential  to  have  available  when  needed. 

Finally,  the  reliance  on  experienced  personnel  to  manage  the  system 
causes  a  severe  strain  on  management  functions.  Once  an  NCO  has  a  solid 
background  in  the  various  aspects  of  hospital  inventory  management,  it  takes 
an  additional  6  months  of  on-the-job  training  working  with  the  Monthly 
Stock  Status  Report  to  become  proficient  at  analyzing  the  report  and  making 
correct  decisions.  The  required  training  time  prevents  many  personnel 
from  becoming  proficient  at  analyzing  the  listing.  Also,  if  a  trained  person 
is  not  available  to  review  tne  report  because  of  leave  or  temporary  duty, 
the  r  ng  does  not  get  reviewed,  compounding  the  number  and  severity  of 
the  inventory  problems  the  next  month. 

The  Medical  Logistics  Management  Branch  management  believes  an 
expert  system  could  alleviate  some  of  these  problems.  If  the  system 
produced  consistent  results  and  allowed  a  junior  NCO  to  analyze  the 
inventory  data  and  come  to  similar  decisions  as  the  senior  NCOs,  some  of  the 
present  management  problems  would  be  eliminated.  While  the  expert 
system  may  not  analyze  the  inventory  data  faster,  it  can  run  24  hours  a  day 
and  generate  action-specific  reports  containing  items  with  similar  problems. 
This  should  allow  for  faster  entry  of  the  corrective  actions  into  the  logistics 
system;  therefore  reducing  the  number  of  work  hours  spent  on  this  process. 

Solving  these  problems  is  of  the  utmost  importance  since  Air  Force 
managers  are  faced  with  the  real  threat  of  deep  personnel  and  financial 
resource  cuts  under  the  current  government  policies.  This  situation 
requires  the  hospital  inventory  management  to  harness  the  power  of 
technology  to  do  more  with  less.  This  also  means  the  junior  NCOs  must 
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learn  how  to  make  decisions  that  are  the  same  as  those  the  experts  make 
within  this  environment. 

The  researcher  and  the  Hospital  Logistics  Management  senior 
personnel  believe  these  goals  can  be  met  by  designing  and  implementing  an 
expert  system.  Because  the  researcher  is  more  interested  in  the  thought 
process  of  the  human  expert,  the  expert  system  is  not  the  goal  of  the 
research.  The  expert  system  is  the  means  by  which  to  verify  if  the 
researcher  captured  the  expert's  decision  process  correctly.  This  position 
is  based  on  a  belief  that  “capturing  knowledge  for  reuse  in  a  new  way  can 
be  a  goal  in  itself"  (20:12). 

Specific  Problem 

Can  the  decision-making  strategies  used  by  hospital  inventory 
management  experts  be  captured  in  an  expert  system  to  help  junior 
managers  make  similar  decisions  similar  to  their  superiors? 

Investi£ative  Questions 

1.  What  type  of  reasoning  strategies  do  hospital  inventory  management 
experts  use  to  solve  inventory  problems? 

2.  If  the  experts  use  heuristic  reasoning; 

A.  Can  the  researcher  generalize  the  specific  heuristics  for 
possible  use  in  solving  other  types  of  problems? 

B.  Can  the  researcher  verify  the  heuristic  reasoning  by  building 
an  expert  system? 

C.  Does  the  expert  system  make  the  same  decisions  as  the  human 
expert? 
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Scope  of  the  Study 

Because  of  time  constraints,  the  research  was  limited  to  the  WPAFB 
Hospital  Logistics  Management  Branch.  The  location  of  WPAFB.  the 
interest  expressed  in  the  project  by  the  Director  of  Logistics  Management, 
and  his  assurance  of  the  cooperation  of  his  personnel  and  the  availability  of 
several  experts  made  WPAFB  the  ideal  choice. 

Limitations 

The  expert  system  was  programmed  using  dBase  III  plus.  The  dBase 
environment  was  chosen  because  it  can  process  large  amounts  of 
information  quickly.  To  use  almost  any  other  programming  language,  the 
raw  data  from  the  computer  would  have  to  be  parsed  from  an  ASCII  file 
and  some  data  preparation  might  have  to  be  done.  Parsing  the  data  and  data 
preparation  would  most  probably  be  done  in  a  dBase  environment  because 
of  its  speed  in  performing  changes  to  large  data  sets.  Using  dBase  will  also 
reduce  the  number  of  times  data  will  have  to  be  passed  from  one  computer 
program  to  another,  reducing  the  chance  for  data  loss  or  damage. 

Since  the  dBase  expert  system  has  very  little  user  interface,  it  was 
decided  to  develop  a  tutorial  using  the  same  decision  rules  as  its  dBase 
counterpart.  The  tutorial  allowed  management  and  those  learning  about 
inventory  management  to  see  how  decisions  are  made  and  allowed  them  to 
run  data  in  an  alternate  environment.  The  tutorial  allowed  personnel  to 
run  a  parsed  dBase  file  or  to  have  the  system  ask  them  interactive  questions 
to  determine  management  actions  for  a  particular  set  of  items.  VP  Expert 
was  the  expert  system  shell  used  for  the  tutorial.  Expert  system  shells 
contain  the  "inference  engine  and  other  control  mechanisms,  while  the  user 
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supplies  the  knowledge”  (11.5).  An  expert  system  shell  was  acceptable  for 
this  project  because  many  companies  are  developing  expert  systems  using 
expert  system  shells  for  commercial  sale  (22:1).  VP  Expert  was  chosen 
based  on  the  ease  of  programming  and  availability.  Ease  of  programming 
was  a  primary  consideration  because  the  hospital  staff  would  have  to 
program  any  future  changes  in  the  knowledge  base  to  reflect  changes  in 
inventory  policy. 

Summary 

This  chapter  discussed  the  decision-making  environment  of  managers 
and  then  discussed  how  expert  systems  interface  with  this  environment. 

The  specific  problem  with  the  investigative  questions  were  then  proposed. 
Chapter  Two  discusses  the  characteristics  of  the  WPAFB  hospital  logistics 
management  account  and  the  data  collection  procedures.  It  also  discusses  the 
underlying  assumptions  of  the  model  and  how  hospital  management  will  use 
the  model.  Chapter  Three  then  outlines  the  specific  method  used  to  conduct 
this  research. 
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II.  Literature  Review 


Overview 

This  chapter  discusses  the  history  of  heuristics,  what  heuristics  are, 
and  then  gives  an  overview  of  what  expert  systems  are  and  some  of  their 
underlying  assumptions.  The  discussion  also  touches  on  some  of  the 
important  differences  between  expert  systems  and  other  computer  programs. 
The  discussion  then  turns  to  the  policies  of  the  WPAFB  Hospital  Logistics 
Management  Branch  and  describes  the  characteristics  of  the  WPAFB 
hospital  logistics  management  inventory  account.  The  chapter  concludes 
with  a  discussion  on  why  the  researcher  and  the  Medical  Logistics 
Management  Branch  personnel  believe  an  expert  system  is  the  best  way  to 
computerize  certain  aspects  of  the  WPAFB  hospital  inventory  management 
decisions. 

History  of  Heuristics 

The  ancient  Greek  mathematician  Pappus  was  the  first  to  describe 
heuristics.  The  following  is  a  paraphrase  by  Polya,  of  Pappus's  report  in 
The  Thirteen  Books  q£  Euclid's  Elements.  "The  so-called  Heuristic  is.  .  .  a 
special  body  of  doctrine  for  the  use  of  those  who.  after  studied  the  ordinary 
Elements,  are  desirous  of  acquiring  the  ability  to  solve  mathematical 
problems,  and  it  is  useful  for  this  alone"  (17. Ml). 

Pappus  believed  heuristics  were  good  for  solving  mathematical 
problems  only  and  could  not  be  applied  to  other  fields  of  study.  This  was 
later  deemed  to  be  false  by  Ren6  Descartes,  who  determined  he  used 
heuristics  or  rules  of  thumb  to  solve  many  different  types  of  problems.  The 
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following  passage  from  Descartes  treatise.  Rules  For  the  Direction  of  Mind. 

shows  how  he  discovered  and  used  heuristics. 

And  whenever  any  book  by  it’s  title  promised  some  new 
discovery,  before  I  read  further  I  tried  whether  I  could  achieve 
something  similar  by  means  of  some  inborn  faculty  of  invention, 
and  I  was  careful  lest  a  premature  perusal  of  the  book  might 
deprive  me  of  this  harmless  pleasure.  So  often  was  I  successful 
that  at  length  I  perceived  that  I  no  longer  came  upon  the  truth  by 
proceeding  as  others  do.  vis.  by  pursuing  vague  and  blind 
inquiries  and  relying  more  on  good  fortune  than  on  skill.  I  saw 
that  by  long  experience  I  had  discovered  certain  rules  which  are 
of  little  help  in  this  inquiry,  and  which  were  used  afterwards  in 
devising  further  rules.  Thus  it  was  that  I  diligently  elaborated 
the  whole  of  this  method  and  came  to  the  conclusion  that  I  had 
followed  that  plan  of  study  which  was  the  most  fruitful  of  all. 

(5:16) 

Heuristics  were  in  use  long  before  Descartes  wrote  about  them. 
Gyorgy  Polya  in  his  book  How  ffi  Solve  IL  describes  heuristics  as  very  old 
problem-solving  strategies  that  were  not  clearly  recorded  in  the  history 
books,  but  were  nevertheless  used  in  a  many  areas  of  study  as  can  be  seen 
in  the  following  passage: 

Heuristic,  or  heuretic,  or  ars  inveniendi’  was  the  name  of  a 
certain  branch  of  study,  not  very  clearly  circumscribed,  belonging 
to  logic,  or  to  philosophy,  or  to  psychology,  often  outlined,  seldom 
presented  in  detail,  and  as  good  as  forgotten  today.  (17:112) 


Definition  of  Heuristic  and  Heuristic  Reasoning 

Even  though  heuristics  have  been  in  use  for  centuries,  and  quite 
possibly  for  millennia,  Polya  was  the  first  to  define  heuristic  as  an 
adjective.  Simply  stated,  it  means  ’’serving  to  discover”  (17:113).  He 
continues  to  say  ”heuristic  discusses  human  behavior  in  the  face  of 
problems,  this  has  been  in  fashion,  presumably,  since  the  beginning  of 
human  society.  .  ."  (17:132).  Ever  since  Polya  gave  a  modern  definition  of 
heuristics,  others  have  followed  by  redefining  heuristic  to  meet  their 
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particular  needs  or  views.  Artificial  intelligence  and  expert  system 

literature  contain  virtually  hundreds  of  definitions  for  heuristic.  Barr  and 

Feigenbaum  give  the  following  definition  of  heuristic  in  their  book  The 

Handbopk  Artificial  Intelligence- 

A  heuristic  (heuristic  rule,  heuristic  method)  is  a  rule  of  thumb, 
strategy,  trick,  simplification,  or  any  other  kind  of  device  which 
drastically  limits  the  search  for  solutions  in  large  problem  spaces. 
Heuristics  do  not  guarantee  optimal  solutions,  in  fact  they  do  not 
guarantee  any  solution  at  all.  all  that  can  be  said  for  a  useful 
heuristic  is  that  it  offers  solutions  which  are  good  enough  most  of 
the  time.  (1:29) 

One  aspect  of  heuristics  that  is  almost  universally  agreed  upon,  is  that 
they  are  useful  for  solving  problems.  However,  not  everyone  sees 
heuristics  as  hard  and  fast  rules  or  methods.  Walter  Reitman  views 
information  as  heuristics  to  aid  in  solving  problems.  He  asserts  information 
about  a  problem  can  suggest  the  order,  to  apply  possible  solutions  to  the 
problem,  and  the  information  might  rule  out  many  solutions  earlier  thought 
possible,  or  may  provide  a  test  by  which  to  distinguish  likely  from  unlikely 
possibilities.  Reitman  s  definition  of  heuristic  is  as  follows:  "All  these  kinds 
of  information  are  heuristics  things  that  aid  discovery.  Heuristics  seldom 
provide  infallible  guidance.  .  .  Often  they  ‘work,’  but  the  results  are 
variable  and  success  is  seldom  guaranteed"  (18:182). 

Judea  Pearl  agrees  with  Reitman  that  heuristics  are  information  based, 
but  adds  the  human  dimension  of  intuition  and  common  sense.  Pearl 
describes  heuristics  as: 

.  .  .  rules  of  thumb,  educated  guesses,  intuitive  judgements  or 
simply  common  sense.  In  more  precise  terms,  heuristics  stand  for 
strategies  using  readily  accessible  though  loosely  applicable 
information  to  control  problem-solving  processes  in  human  beings 
and  machine.  (14:vii) 
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Pearl  continues  to  say  heuristics  represent  a  compromise  between  two  basic 
requirements  of  decision-making:  the  need  to  keep  criteria  simple  and  the 
need  to  “discriminate  correctly  between  good  and  bad  choices"  (14:3). 

Herbert  Simon  builds  his  definition  of  heuristic  on  a  foundation  of 
simplifying  the  problem  at  hand  so  a  human  expert  can  come  to  a  reasonable 
decision.  He  describes  heuristic  search  as  a  “powerful  problem-solving  and 
decision-making  tool  for  people  who  are  unassisted  by  any  computers  except 
their  own  minds,"  and  must  simplify  the  problem  to  find  an  approximate 
solution.  He  continues  to  say  heuristics  are  the  "principle  engine  for 
human  problem  solving"  (23:35-36). 

Since  there  are  so  many  different  definitions  of  heuristic,  the 
literature  often  blurs  the  definitions  of  heuristics,  heuristic  reasoning,  and 
heuristic  search,  and  uses  the  terms  interchangeably.  It  is  not  as  important 
to  be  able  to  distinguish  between  these  terms  as  it  is  to  understand  the 
power  of  heuristics  and  their  effect  on  every-day  problem  solving.  In  the 
following  passage,  Polya  states  the  power  of  heuristics,  which  sets  the 
platform  for  the  rest  of  this  research.  This  definition  of  heuristic  reasoning 
is  as  follows: 

Heuristic  reasoning  is  reasoning  not  regarded  as  final  and  strict 
but  as  provisional  and  plausible  only,  whose  purpose  is  to 
discover  the  solution  of  the  present  problem.  We  are  often 
obliged  to  use  heuristic  reasoning.  We  shall  attain  complete 
certainty  when  we  shall  have  obtained  the  complete  solution,  but 
before  obtaining  certainty  we  must  often  be  satisfied  with  a  more 
or  less  plausible  guess.  We  may  need  the  provisional  before  we 
attain  the  final.  We  need  heuristic  reasoning  when  we  construct 
a  strict  proof  as  we  need  scaffolding  when  we  erect  a  building. 

(17:113) 

As  seen,  heuristics  form  the  cornerstone  of  human  thought  processes 
and  are  discovered  by  solving  problems  and  by  watching  others  solve 
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problems  (17:130).  Observing  others  solving  problems  forms  the  basis  of 
knowledge  engineering,  which  is  a  process  for  building  expert  systems. 

Expert  systems  are  computer  programs  which  apply  logic  based  on 
heuristics  and  heuristic  reasoning.  The  next  few  sections  discuss  what 
expert  systems  are  and  their  relationship  to  and  some  of  their  differences 
from  other  computer  programs. 

Definition  of  Expert  System 

Schoen  describes  an  expert  system  as: 

...  a  computer  program  designed  to  represent  knowledge  of  a 
particular  subject  as  provided  by  a  human  expert  or  other 
source  of  information.  The  system  also  includes  procedures  for 
using  this  knowledge  to  arrive  at  a  solution  to  a  problem  of  the 
type  which  would  normally  require  human  expertise.  (20:5) 

This  description  states  expert  systems  make  decisions  in  domains 

normally  reserved  for  some  human  expert.  Also  note,  that  expert  systems 

are  generally  developed  for  a  specific  field  or  area  of  study.  Thus,  the 

focus  of  expert  systems  is  on  enriching  the  human  decision-making 

environment  and  increasing  the  quality  and  consistency  of  routine  decision 

making  (20:6). 

Characteristics  of  an  Expert  System 

Expert  systems  are  able  to  enrich  the  human  decision-making 
environment  by  manipulating  known  facts  using  heuristics  and  an  inference 
strategy  from  an  expert.  Expert  systems  use  heuristics  to  apply  logic,  thus 
manipulating  known  facts  to  create  new  facts.  These  new  facts  combined 
with  the  old  facts  allow  the  expert  system  to  arrive  at  a  problem  solution. 
The  manipulation  of  known  facts  is  accomplished  by  applying  the  expert's 
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knowledge,  captured  through  the  observation  of  the  decision-making 
processes  or  knowledge  engineering.  Expert  systems  can  also  provide  this 
knowledge  to  many  other  inexperienced  decision  makers,  which  effectively 
increases  the  number  of  available  experts  within  the  organization  (12). 

Expert  systems  can  also  provide  consistent,  affordable,  transportable, 
and  permanent  expertise  to  most  any  decision  maker.  These  characteristics 
give  expert  systems  their  popularity  and  usefulness.  If  the  system  is  posed 
with  the  same  information  repeatedly,  it  will  always  give  the  same  result. 
On  the  other  hand,  a  human  expert  in  a  like  situation  might  give  two 
different  answers.  Besides  being  consistent,  expert  systems  are  affordable. 
This  is  because  the  organization  does  not  have  to  hire  an  expert  for 
projects  calling  for  the  knowledge  the  expert  system  already  contains.  Once 
the  company  has  paid  for  an  expert  system,  they  can  use  it  to  solve  similar 
problems  in  other  projects.  The  knowledge  of  expert  systems  is  also  easily 
transportable  and  permanent.  Most  expert  systems  can  run  on  small 
portable  computers,  and  the  disk  containing  the  program  can  be  mailed 
between  offices  or  divisions.  This  has  the  added  benefit  of  lending 
predictability  in  touchy  situations  around  the  company.  Also,  since  the 
knowledge  is  in  a  computer  program,  it  will  still  be  there  tomorrow,  as 
computers  do  not  retire  or  get  transferred  to  another  division  (12). 

Expert  System  Design 

Some  of  the  previously  mentioned  characteristics  of  expert  systems 
stem  from  the  design  of  expert  systems.  There  are  many  different  expert 
system  designs  in  the  literature,  but  all  of  them  share  the  following  three 
elements: 
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1.  Knowledge  base  (or  knowledge  source )--a  domain  of 
facts  and  heuristics  associated  with  the  problem. 

2.  Inference  procedure  (or  control  structureJ--uses  the 
knowledge  base  to  find  a  solution  to  the  problem. 

3.  A  working  memory  (or  global  data  base)'-keeps  track 
of  problem  status,  input  data,  and  rules  used  in  the  solution 
process  (9:47) 

Figure  2  pictorially  shows  the  relationship  of  these  three  elements  of 
expert  systems. 


Figvire  2.  Basic  Structure  of  an  Expert  System  (9;52) 
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The  wiring  diagram  in  Figure  2  is  simitar  for  many  other  types  of 
computer  systems,  including  decision  support  systems.  Though  expert 
systems  are  very  similar  to  decision  support  systems,  there  are  distinct 
differences  in  the  way  they  store  and  use  the  information  available  to  them 
(Table  1).  The  main  difference  of  expert  systems  and  other  computer 
programs  is  "their  knowledge  is  separate  from  the  inference  mechanism  and 
they  explain  their  reasoning”  (8:9).  Though  the  two  types  of  systems  are 
different,  many  people  use  expert  systems  as  decision  support  systems. 

Table  1 


Comparison  of  Expert  System  and  Decision  Support  System  (20:50) 


Primary  Function 

Make  available 
knowledge  of  an  expert 

Assist  in  decision  making 

Application 

Unique,  complex,  or 
ill-defined  problems 

Structured  or  repetitive 
problems 

Major  Focus 

Dissemination  of 
expertise 

Support  decision  making 

Problem  Domain 

Complex,  wide 

Narrow 

Data  Representation 

Symbolic 

Numeric 

Information  in  Data  Base 

Procedural  and  factual 

Factual 

Human  Interface 

System  poses  questions 

Human  poses  questions 

Reasoning  Capability 

Yes.  but  limited 

No 

Explanation  Capacity 

Yes 

No 

Source  of 
Recommendation 

The  system 

Human  (using  system 
input) 
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Knowledge  Bottlenecks 


As  with  many  other  types  of  computer  programs,  the  gathering  of  the 
information  needed  by  an  expert  system  to  operate  efficiently  can  cause 
many  problems.  Knowledge  engineering,  or  knowledge  acquisition,  is  the 
gathering  and  "transformation  of  problem-solving  expertise  from  some 
knowledge  source  to  a  program"  (21:321).  The  knowledge  acquisition 
process  is  the  main  bottleneck.  This  happens  for  at  least  one  of  the 
following  reasons: 

1.  The  expert  has  trouble  verbalizing  the  rules  he  follows. 

2.  There  are  no  experts  or  a  lack  of  consensus  among  the  experts 

3.  The  expert  system  needs  a  mechanism  to  refine  its  rules  (21.316). 

Once  the  expert's  knowledge  has  been  captured,  it  is  translated  into 
some  formal  computer  language  and  entered  in  the  system  as  expressions.  A 
specialized  programmer  or  knowledge  engineer  does  the  translation, 
meaning  only  a  limited  number  of  people  have  both  the  problem  domain 
knowledge  and  programming  knowledge.  This  results  in  a  knowledge 
bottleneck  ( 16:1-5).  Freiling  reflects  this  type  of  thinking  in  his  definition 
of  knowledge  bottleneck,  but  also  sees  the  bottleneck  forming  because  of 
inadequate  dispersal  of  much  needed  knowledge.  His  definition  is  as 
follows: 

In  any  large  organization  it  is  quite  common  to  find  pockets  of 
knowledge  or  knowledge  bottlenecks.  Pockets  of  knowledge 
occur  when  knowledge  crucial  to  the  success  of  an  organization  is 
possessed  by  only  one  or  a  few  individuals.  Knowledge 
bottlenecks  are  pockets  of  knowledge  that  impede  an  organization  s 
progress  uecause  the  knowledge  needs  to  be  more  widely 
distributed.  .  .  .  Pockets  of  knowledge  can  quickly  become  serious 
bottlenecks  if  the  individuals  retire  or  decide  to  leave  the 
organization.  (7:37) 
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Expert  systems  can  help  with  the  distribution  of  critical  knowledge 
throughout  an  organization.  This  critical  knowledge  is  not  only  found  in  the 
minds  of  experts,  but  often  is  found  in  the  management  policies  of  the 
organization.  Therefore,  a  good  understanding  of  the  WPAFB  hospital 
logistics  management  policies  is  as  important  as  understanding  heuristics  and 
the  characteristics  of  expert  systems. 

The  Logistics  Management  Branch  follows  the  guidance  as  outlined  in 
AFM  67-1  for  monitoring  inventories  AFM  67-1  contains  no  procedures 
concerning  the  review  of  the  Monthly  Stock  Status  Report.  It  does  however 
contain  definitions  of  the  fields  contained  within  the  Monthly  Stock  Status 
Report.  It  does  say  the  medical  Logistics  Management  Branch  “should 
maintain  a  minimal  level,  based  upon  average  usage  and  resupply 
frequency,  of  recurring  demand  consumable  supplies"  (4:10-1).  There  are 
also  no  local  policy  letters  on  file  regarding  the  decision  process  for  the 
Monthly  Stock  Status  Report  or  inventory  management  techniques.  During 
the  past  Staff  Assistance  Visit  (SAV),  the  inspector  suggested  the  Logistics 
Management  Branch  reduce  the  size  of  its  inventory  through  a  reduction  of 
assets  in  economic  retention  status.  This  guidance  was  given  verbally  and  is 
not  contained  in  the  SAV  report. 

WPAFB  Lofiistics  Management  Inventory  Account 

This  logistics  management  guidance  is  applied  to  a  large  and  very 
dynamic  medical  supplies  inventory.  The  WPAFB  medical  supplies 
inventory  consists  of  approximately  7,000  line  items  with  a  total  dollar  value 
exceeding  one  miluon  dollars.  Approximately  250  line  items  are  added  and 
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200  items  deleted  from  the  inventory  each  month.  The  Monthly  Stock  Status 
Report  contains  2700  line  items  per  month.  This  report  contains  potential 
problem  items  in  the  inventory  and  all  items  requiring  manual  monitoring. 
This  report  is  computer  generated  and  does  not  give  a  recommended 
corrective  action. 

Why  An  Expert  System? 

From  the  discussion  so  far.  it  can  be  concluded  that  the  WPAFB 
medical  logistics  inventory  account  is  large  and  very  complex,  and  that  there 
is  very  little  guidance  provided  in  either  Air  Force  Regulations  or  local 
policies  on  the  types  of  decisions  under  investigation.  This  obvious  lack  of 
guidance  means  inventory  managers  must  rely  on  their  expertise  and 
experience  to  make  decisions.  Given  the  size  and  dynamics  of  the  logistics 
account  and  the  number  of  items  contained  in  the  Monthly  Stock  Stock 
Report,  it  is  difficult  for  the  managers  to  continually  make  decisions 
concerning  the  status  of  items  in  the  account.  Therefore,  the  managers  a/e 
looking  for  a  way  to  automate  this  decision  making  process. 

In  order  to  automate  the  system,  one  must  first  examine  the  reasonings 
of  the  experts  in  the  particular  field.  When  this  is  accomplished,  "we  shall 
perhaps  be  relieved  entirely  of  the  task  of  constructing  a  new  logic  norm 
and  action”  (i9;l).  This  examination  will  also  allow  the  knowledge  to  be 
examined,  and  if  any  flaws  are  found,  they  can  be  corrected;  thus  improving 
the  knowledge  beyond  what  is  presently  used  (19:1). 

Given  the  circumstances  surrounding  the  medical  logistics  inventory 
account  and  the  environment  in  which  expert  systems  can  operate,  their 
characteristics  and  how  knowledge  is  obtained  and  used,  expert  systems  are 
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an  ideal  choice  for  this  particular  problem.  Use  of  an  expert  system  will 
allow  for  the  automation  of  the  "techniques  for  representing  and  executing 
judgement  on  existing  databases”  such  as  those  used  to  support  the  hospital 
logistics  management  inventory  account  (10:^2).  An  expert  system  would 
also  "provide  an  unambiguous  demonstration  that  a  mechanism  equipped 
with  a  set  of  methods  and  rules  of  thumb  .  .  .  can  solve  a  significant  number 
of  problems  in  domains  once  the  exclusive  preserve  of  human  intelligence” 
(18:154-155). 

Summary 

This  chapter  discussed  heuristics  and  how  they  have  been  viewed  and 
used  throughout  history.  The  characteristics  of  expert  systems  were 
discussed  to  provide  a  better  understanding  of  how  they  operate  and  the 
environment  in  which  they  operate.  The  discussion  then  led  to  the  logistics 
policies  the  Hospital  Logistics  Management  Branch  follows  and  some  of  the 
characteristics  of  their  inventory  account  and  why  an  expert  system  is  a 
good  choice  in  this  given  situation.  The  next  chapter  will  discuss  the 
methodology  used  to  conduct  the  research  at  hand. 
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III. 


Qvgfvigw 

This  chapter  discusses  the  methodology  used  to  discover  the  decision 
processes  used  by  the  experts  and  the  methodology  used  to  develop  the 
expert  systems.  The  methodology  was  chosen  for  its  easy  implementation 
and  the  fact  that  it  produced  some  type  of  physical  evidence  of  progress 
even  though  an  actual  computer  program  was  not  written  until  late  in  the 
process.  Following  this  is  a  discussion  of  the  statistical  tests  used  to  validate 
the  expert  system  and  how  these  tests  were  applied. 

Knowledge  Enginfcerin^ 

Starting  a  new  knowledge  engineering  project  is  a  difficult  challenge 
for  both  the  novice  and  the  experienced  knowledge  engineer.  There  are 
two  main  reasons  for  this.  First:  the  intuitions  and  requirements-oriented 
methods  learned  when  developing  programs  does  not  apply  well  to 
knowledge  engineering  tasks.  Second:  the  "methodologies  for  developing 
expert  systems  by  extracting,  representing,  and  manipulating  an  expert's 
knowledge  have  been  slow  in  coming"  (7:37). 

To  make  a  knowledge  engineering  project  easier  and  appreciate  the 
process,  one  must  recognize  there  are  three  basic  underlying  assumptions  to 
the  knowledge  engineering  process.  First,  knowledge  is  more  important 
than  the  inference  strategy  (7:37).  In  short,  this  means  knowledge  is  more 
important  than  the  way  the  expert  applies  his  knowledge.  Often  the 
knowledge  engineer  only  has  time  to  acquire  the  knowledge  or  the  inference 
strategy.  Since  it  is  easier  to  recreate  the  inference  strategy  than  the 
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knowledge,  the  knowledge  engineer  should  gather  the  knowledge.  Once  the 
knowledge  is  gathered,  the  knowledge  engineer  has  the  luxury  of  being  able 
to  work  on  it  later  when  time  is  not  such  a  limiting  factor  to  develop  an 
expert  system.  This  situation  can  occur  when  people  retire  or  leave  the 
company  after  many  years  and  have  not  shared  their  expertise.  In  cases  tike 
this,  it  is  essential  to  make  the  time  to  gather  the  knowledge  so  it  is  not  lost. 

The  second  assumption  "is  that  knowledge  cannot  be  gotten  all  at  once ' 
(15:169).  This  assumption  implies  that  an  expert  can  not  elicit  all  his 
knowledge  in  a  two  hour  knowledge  engineering  session.  In  fact,  if  this 
assumption  is  taken  to  the  extreme,  the  knowledge  engineer  will  never 
obtain  all  the  information  an  expert  knows  on  the  subject  in  qu:»stion. 

The  final  assumption  is: 

a  knowledge  engineering  project  must  provide  adequate 
documentation  of  its  progress.  At  any  stage  in  the  process, 
knowledge  engineers  must  be  able  to  show  some  fruits  of  their 
labor.  (7:37) 

Freiling  suggests  a  six  step  approach  to  knowledge  engineering  which 
embodies  the  three  previous  assumptions.  An  outline  of  this  approach  is  in 
Table  2.  Only  the  first  four  steps  of  Freiling ’s  six  step  approach  are 
discussed  because  it  was  not  necessary  for  the  researcher  to  build  an 
inference  engine  or  extensive  user  interface  for  either  expert  system.  The 
dBase  expert  system  had  minimal  user  interface  because  once  it  knows  what 
file  to  act  on  it  makes  decisions  and  prints  the  results  automatically.  The 
inference  engine  and  the  user  interface  are  part  of  the  VP  Expert  system 
shell  used  for  the  tutorial. 

The  first  three  steps  are  “aimed  at  acquiring  and  representing  the 
knowledge  necessary  for  solving  the  problem"  (7:42).  and  the  fourth  step  is 
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the  actual  builaing  of  the  knowledge  base.  Associated  with  each  step  is 
some  form  of  documentation  which  acts  as  a  deliverable  product  to  show  the 
successful  conclusion  of  any  given  step.  This  documentation  is  important 
because  it  can  be  used  to  show  progress  on  the  project  even  though  a 
computer  program  has  not  yet  been  written  (7:42). 

TABLE  2 

Six  Steps  of  Knowledge  Acquisition  (7:41) 

Knowledge  Definition  Phase 


Number 

Step 

Proiect  Document 

(1) 

Familiarization 

Paper  knowledge  base 

(2) 

Organizing  knowledge 

Knowledge  acquisition 
grammar 

(3) 

Representing  knowledge 

Internal  knowledge  base 
formats 

Prototype  Implementation  Phase 

Number 

Sifiil 

Proiect  Document 

(4) 

Acquiring  knowledge 

Knowledge  base 

(5) 

Inference  strategy  design 

Inference  engine 

(6) 

Interface  design 

Interface 

A  step-by-step  approach  has  several  advantages  (7:37).  First,  it  allows 
a  knowledge  engineering  project  to  proceed  from  "initiation  to 
implementation  without  inducing  conceptual  bottlenecks  into  the 
development  process"  (7:37).  Second,  by  using  a  step  by  step  approach,  one 
can  see  wider  applicability  for  this  approach.  When  this  approach  is 
communicated  to  others,  it  helps  reduce  both  "development  times  and  the 
level  of  external  consulting  required  by  other  projects"  (7:41).  Third. 
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though  this  process  does  not  describe  how  experts  think,  it  does  describe 
"how  most  acquisition  interviews  .-ieem  to  work"  05:165).  If  the  knowledge 
engineer  understands  this  method,  he  will  then  know  where  in  the  process 
he  is.  and  he  can  guide  the  interview  accordingly  (15:165), 

The  Knowledfie  Definition  Phase 

Every  knowledge  engineering  project  begins  with  the  knowledge 
definition  phase.  The  main  emphasis  at  this  stage  is  to  analyze  a  large 
complex  problem  while  not  getting  caught  up  in  the  specifics  of  the  problem 
(7:-ll). 

Step  i  -  Familiarization.  In  this  stage  of  the  project,  the  knowledge 
engineer  determines  the  "scope  and  complexity  of  the  task"  ilAl).  An 
obvious  first  step  is  to  "read  whatever  written  sources  you  can  find  that 
provide  a  high-level  perspective  on  the  domain.  As  you  read,  note  key 
terms,  definitions,  and  ambiguities  in  meaning"  (15:163).  During  this  stage  of 
the  project,  the  knowledge  engineer  should  choose  a  representative  problem 
which  is  simple  and  not  very  complex  to  familiarize  himself  with  basic 
problems.  Also,  during  the  first  few  knowledge  engineering  sessions,  the 
knowledge  engineer  should  watch  the  expert  solve  these  problems  or  discuss 
with  the  expert  how  to  solve  the  problem  to  expand  the  knowledge 
engineer's  understanding  of  the  problem  domain  (7:‘42) 

Good  technique  in  this  stage  means  the  knowledge  engineer  must  not 
only  capture  the  knowledge  reliably,  but  needs  to  commit  it  to  some  medium 
which  can  be  reviewed  and  analyzed  later  (15:163).  When  the  session  is 
over,  the  tapes  and  notes  are  combed  and  transcribed  in  an  effort  to  develop 
a  paper  knowledge  base  consisting  of  English  sentences  representing  the 
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facts  and  rules  elicited  from  the  expert  (7:43).  This  step  is  necessary  as 
new  knowledge  may  be  obtained  and  old  knowledge  clarified  during  this 
review.  After  the  knowledge  is  put  into  English  and  diagrams,  the  expert 
must  review  the  paper  knowledge  base  for  completeness  and  accuracy 
( 15:163-164).  It  will  most  likely  take  many  sessions  with  the  expert  before 
the  paper  knowledge  base  reaches  a  stable  form.  The  paper  knowledge  base 
serves  as  the  documentation  for  this  stage  of  the  project  (7:43). 

Step  2  -  Organizing  Knowledge.  As  the  paper  knowledge  base  gets 
larger,  it  will  soon  be  out  of  control.  Regularities  or  patterns  should  start 
to  appear  frequently  in  the  document  and  the  knowledge  engineer  must 
group  these  regularities  together,  "The  next  step  is  to  capture  these 
regularities  by  building  a  knowledge  acquisition  grammar  to  express  the 
facts  and  rules  in  the  paper  knowledge  base"  (7:43).  The  syntactic 
definition  of  the  knowledge  acquisition  grammar  forms  the  documentation 
for  this  step  (7:43). 

Step  3  -  Representing  Knowledge.  After  the  knowledge  acquisition 
grammar  is  specified,  it  is  used  to  guide  "how  the  knowledge  is  to  be 
represented  in  a  prototype  expert  system"  (7:44).  These  internal  knowledge 
base  formats  are  the  actual  expressions  which  will  be  used  to  program  the 
prototype  expert  system.  The  definition  of  the  internal  knowledge  base 
formats  becomes  the  documentation  of  this  stage  (7.44). 

Step  4  -  Acquiring  Knowledge.  At  this  point  of  the  project,  the 
semantic  grammar  and  the  internal  rule  formats  have  been  defined  and  the 
knowledge  engineer  can  now  make  a  "wholesale  effort  to  acquire 
knowledge  relevant  to  a  particular  task"  (7:45). 
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The  documentation  of  this  step  is  a  prototype  knowledge  base, 
containing  facts  and  rules  specially  relevant  to  the  prototype 
under  construction.  The  prototype  knowledge  base  will  exist  in 
two  forms,  an  external  knowledge  base  consisting  of  rules  as 
acquired  from  the  expert  in  English  and  an  internal  knowledge 
base  ready  to  be  processed  by  some  inference  engine.  (7:^5) 

Experience  has  shown  the  knowledge  "elicited  from  the  expert  consists 

primarily  of  references  to  objects,  relations,  observations,  and  events  which 

are  well  known  in  the  problem  world"  (7:46).  It  is  at  the  final  grammatical 

processing  that  the  "references  aggregate  into  heuristic  connections,  say 

between  an  observation  and  a  conclusion”  (7:46).  This  is  not  surprising. 

because  “heuristics  are  discovered  by  consulting  simplified  models  of  the 

problem  domain"  (14:115)  and  often  appear  as  repetitions  in  the  problem 

solving  process. 

Interviewing 

A  very  important  part  of  the  knowledge  acquisition  process  is 
interviewing  the  expert.  These  interviews  are  usually  unstructured  to 
allow  the  researcher  to  probe  as  deeply  as  necessary  to  gain  a  full 
understanding  of  the  problem  and  its  domain. 

The  importance  of  good  interviewing  techniques  cannot  be  over 
emphasized,  as  the  knowledge  engineer  must  interview  at  least  one  expert  to 
develop  a  system.  One  of  the  first  rules  of  successful  interviewing  is  to 
allow  the  expert  to  complete  his  thoughts  without  interruptions  from  the 
researcher.  This  keeps  the  expert  from  getting  off  track  which  "may  stop 
the  flow  of  a  productive  hypothesis"  (15:170).  The  interviewer  should  take 
notes  of  the  side  areas  the  expert  touches  on  in  order  to  ask  questions  about 
these  areas  after  the  expert  finishes  speaking.  Also,  the  exchange  of  ideas 
should  not  be  limited  by  your  ability  to  immediately  absorb  everything  the 
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expert  says.  This  could  drastically  affect  the  amount  of  output  you  receive 
(15:170). 

Another  factor  affecting  the  amount  of  output  you  receive  is  that  some 
experts  may  have  great  difficulty  expressing  their  thoughts,  or  might  give 
answers  which  are  shallow  or  incomplete.  These  types  of  problems  happen 
frequently  and  the  researcher  “must  deal  with  these  factors  and  use 
procedures  which  encourage  and  clarify  responses”  (24:15).  Probing  is  a 
procedure  which  can  help  to  overcome  these  difficulties.  A  probe  has  two 
major  purposes:  first,  it  must  motivate  the  expert  to  clarify  or  explain  the 
reasons  behind  what  was  said  or  done.  Second,  it  must  focus  the  expert’s 
attention  on  the  problem  so  "irrelevant  and  unnecessary  information  can  be 
avoided”  (24:15).  most  important  thing  to  remember  about  a  probe  is  it 
must  not  intro 'd  bias  (24:15). 

There  are  several  different  kinds  of  probes.  First  there  is  repeating 
the  question,  which  allows  the  expert  hear  the  question  one  more  time 
giving  him  time  to  think  and  collect  thoughts  while  focusing  on  the  question. 
The  expectant  pause  is  the  simplest  way  to  convey  understanding  that  the 
expert  has  begun  to  answer,  but  acknowledges  there  is  more  to  be  said. 
Repeating  the  expert's  reply  is  another  important  probing  technique  which 
allows  the  expert  to  hear  his  answer  and  reflect  on  the  information  he  has 
given.  Another  means  is  asking  for  further  clarification  (24:15-16).  Lastly, 
"ask  one  question  at  a  time,  preferably  subjunctive  questions  that  use  words 
like  ‘might.’  should.'  could.’  would,’  and  assuming’.  Then  be  quiet  and 
listen”  (15:172).  All  in  all. 

successful  probing  requires  that  you  recognize  immediately 

just  how  the  respondents  answer  has  failed  to  meet  the 
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objective  of  the  question  and  then  be  able  to  formulate  a 
neutral  probe  to  elicit  the  information  needed.  (24:16) 

After  understanding  the  discussed  techniques,  the  knowledge  engineer 
was  ready  to  conduct  the  research  in  three  phases:  knowledge  acquisition 
and  analysis,  expert  system  development,  and  validation  of  the  expert  system. 
During  the  research,  these  phases  often  overlapped  each  other.  Each 
individual  phase  is  discussed  in  turn  in  the  following  sections. 

Knowledge  Acquisition  and  Analysis 

The  objective  of  this  phase  of  the  research  was  to  acquire  the  expert 
knowledge  to  determine  the  reasoning  strategiw^  u.  ed  by  the  inventoiT 
management  experts  and  to  develop  a  prototype  of  the  expert  system  and 
dBase  program. 

Step  1  -  Background  Information.  The  first  step  was  for  the 
researcher  to  become  familiar  with  the  types  of  problems  to  be  solved  and 
the  problem  domain.  To  accomplish  this,  the  researcher  obtained  an 
annotated  copy  of  the  Monthly  Stock  Status  Report  to  analyze.  The 
researcher  then  reviewed  the  report  to  become  familiar  with  the  variables 
involved  in  the  problem  domain  and  to  determine  some  of  the  relationships 
between  these  variables  After  the  initial  familiarization,  the  researcher 
chose  several  representative  problems  and  developed  several  modifications 
by  changing  the  values  of  some  variables  and  had  the  expert  reevaluate  the 
problem.  First,  the  researcher  modified  the  variables  one  at  a  time  while 
holding  all  others  constant,  then  at  other  times,  the  researcher  modified  the 
variables  in  combination  to  check  for  interaction  between  the  variables. 
During  this  phase  the  researcher  also  reviewed  applicable  regulations. 
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manuals,  and  policy  letters  of  the  medical  logistics  field  to  develop  a  sound 
understanding  of  hospital  logistics  management  policies. 

Step  2  -  Expert  Selection.  Once  familiarized  with  the  problem  domain, 
the  researcher  then  began  the  task  of  selecting  an  expert.  The  WPAFB 
Medical  Logistics  Branch  had  two  senior  Noncommissioned  Officers  (NCO) 
who  were  possible  candidates  to  act  as  experts  for  this  research.  The 
Director  of  Medical  Logistics  recommended  both  NCOs.  and  each  has  over  15 
years  of  experience  in  medical  logistics.  The  researcher  used  only  one 
expert  for  the  knowledge  acquisition  phase,  because  one  NCO  attended  the 
Senior  NCO  Academy  during  this  phase,  and  was  unavailable.  How'ever. 
both  experts  were  used  to  verify  the  expert  system  results. 

Step  i  -  Extracting  Knowledge.  After  the  researcher  selected  an 
expert,  he  began  the  process  of  extracting  the  expert's  knowledge.  During 
this  crucial  step  the  expert  solved  the  problems  selected  in  step  1.  The 
knowledge  engineer  first  observed  the  expert  solve  the  problem,  then 
probed  the  expert  as  needed  to  acquire  additional  information  and  a 
thorough  understanding  of  the  problem.  The  knowledge  engineer  continued 
to  present  problems  and  probe  the  expert  until  thorough  understanding  of 
the  problem  solving  techniques  was  reached. 

The  knowledge  engineer  conducted  ten  1  hour  problem  solving  sessions. 
Each  session  was  tape  recorded  and  copious  notes  were  taken.  After  each 
session  the  knowledge  engineer  listened  to  the  tapes  and  referred  to  the 
notes  to  extract  the  facts  and  rules  used  to  solve  the  problems.  This  data 
extraction  formed  the  paper  knowledge  base  described  prevtausly. 

Step  -  Knowledge  Analysis.  Analysis  of  the  paper  knowledge  base 
for  patterns  and  regularities  started  upon  completion  of  the  paper 
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knowledge  base.  These  regularities  form  the  heuristics  involved  in  solving 
the  problems.  Analysis  and  generalization  of  the  specific  heuristics  then 
proceeded. 

SYStsm  Hev-eiocingat 

This  phase  of  the  research  involved  building  a  working  prototype 
expert  system  from  the  paper  knowledge  base  and  developing  the  expert 
system  into  a  fully  operational  system.  The  process  proceeded  in  a  stepwise 
manner  to  reduce  the  number  of  problems  with  incompatible  rules. 

After  gaining  a  thorough  understanding  of  the  problem  solving  process, 
the  knowledge  engineer  coded  that  particular  portion  of  the  paper 
knowledge  base  into  a  quasi  machine  code.  The  expert  then  reviewed  the 
English  knowledge  base  for  accuracy.  The  expert  changed  the  English  code 
and  the  knowledge  engineer  later  changed  the  quasi  machine  code.  The 
knowledge  engineer  then  programmed  a  prototype  expert  system  using  the 
quasi  machine  code  as  a  guide. 

When  the  knowledge  engineer  believed  the  prototype  made  the  correct 
decisions,  the  prototype  was  demonstrated  for  the  expert.  The  expert  solved 
a  given  set  of  problems  by  hand  and  then  solved  the  same  problems  using  the 
prototype  expert  system.  If  the  system  did  not  produce  a  similar  answer,  the 
knowledge  engineer  and  the  expert  analyzed  the  prototype  knowledge  base 
for  completeness  and  accuracy.  This  process  was  repeated  several  times 
varying  the  input  data.  Once  the  prototype  expert  system  performed 
adequately  and  the  knowledge  engineer  understood  a  different  type  of 
problem  well  enough,  a  new  type  of  problem  was  added  to  the  prototype 
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system  in  the  same  manner.  This  process  continued  until  the  system  could 
so’*  e  all  types  of  problems  and  performed  as  well  as  the  expert. 

System  Validatio; 

Once  the  prototype  performed  adequately,  the  researcher  began  efforts 
to  validate  the  system.  This  phase  of  the  research  involved  comparing  the 
results  of  the  expert  system  with  those  of  the  expert.  The  researcher  took  a 
stratified  random  sample  from  each  month  of  available  data  to  validate  the 
system.  A  stratified  random  sample  was  chosen  because  the  total  inventory 
consists  of  over  7,000  line  items,  and  the  researcher  wanted  to  ensure  all 
price  ranges  of  items  were  represented.  Robert  O’Keefe  suggests  a 
stratified  random  sample  because  the  real  'issue  is  not  the  number  of  test 
cases,  it  is  the  coverage  of  test  cases— that  is  ,  how  well  they  reflect  the 
input  domain"  (13:83).  A  computer  generated  the  uniform  random  numbers 
to  be  used  for  the  stratified  random  sample  of  the  inventory  leveling  data. 
The  inventory  leveling  data  was  stratified  by  using  price  as  a  criteria.  The 
specific  groups  used  were:  less  than  ten  dollars  per  unit,  between  ten 
dollars  and  less  than  100  dollars  per  unit,  and  more  than  100  dollars  per  unit. 
Leveling  data  was  used  because  the  researcher  could  not  capture  the 
Monthly  Stock  Status  Report  data  as  it  is  deleted  once  the  report  is  written. 
The  leveling  data  was  an  excellent  alternative  as  it  is  modified  by  a  report 
generating  program  to  produce  the  Monthly  Stock  Status  Report.  Appendix 
B  contains  a  description  of  the  data  elements  contained  in  the  leveling  data 
file. 

Using  preliminary  estimates  for  the  size  of  the  account  and  its  standard 
deviation,  the  number  of  problem  items  iri  the  account  and  its  standard 
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deviation,  and  a  95  percent  confidence  factor,  the  optimal  sample  size  was 
determined  to  be  39  using  the  formula  found  in  Business  Research  Methods 
by  Emory  (6:2%).  Appendix  C  contains  the  data  used  to  "determine  the 
sample  size.  To  account  for  any  errors  in  the  estimates,  a  sample  size  of 
fifty  was  used  for  all  sample  sets.  To  give  the  statistical  tests  used  to 
determine  if  the  expert  system  was  operating  as  planned  significant  value. 
15  random  samples  were  taken  over  a  period  of  9  months  of  inventory 
leveling  data  and  can  be  found  in  Appendix  D. 

The  researcher  edited  each  decision  file  so  that  it  contained  only  the 
data  from  the  random  sampling.  The  researcher  then  appended  the  expert’s 
responses  taken  from  a  hard  copy  of  the  selected  items  to  the  file  on  the 
computer.  The  researcher  then  compared  the  decisions  made  by  the  expert 
system  to  the  human  expert’s  decision.  If  the  decisions  did  not  match,  the 
researcher  consulted  with  the  expert  to  see  if  a  mistake  had  been  made.  If 
the  expert  stood  by  his  decision,  the  researcher  then  tried  to  determine  if 
the  program  contained  faulty  logic  or  if  there  were  unusual  characteristics 
within  the  data  causing  the  discrepancy. 

Once  the  researcher  determined  all  decisions  were  accurate  and 
correct,  he  compared  the  results  statistically.  This  was  done  by  calculating 
a  95  percent  confidence  interval  of  the  mean  number  of  responses  that 
agreed,  across  all  15  data  sets.  First,  the  researcher  performed  a  t  test  on 
the  decisions.  To  accomplish  this,  the  researcher  compared  both  sets  of 
responses  and  assigned  a  numerical  value  of  zero  for  decisions  that  agreed, 
and  a  value  of  one  for  decisions  that  disagreed.  Next,  a  two-tailed  t  test  was 
performed  using  a  mean  of  zero.  Lastly,  the  t  probability  value  was 
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analyzed  using  a  confidence  limit  of  95  percent  to  determine  if  the  mean  of 
the  distribution  was  in  fact  zero. 

Summary 

This  w.iapter  described  the  procedure  used  to  conduct  the  research  in 
an  effort  to  answer  the  investigative  questions.  It  discussed  the  process 
used  to  gather  and  analyze  the  knowledge  and  build  the  expert  system.  The 
discussion  ted  to  how  the  researcher  measured  the  effectiveness  of  the 
expert  system  he  developed.  The  next  chapter  will  discuss  the  results  of  the 
research. 
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IV.  Findtn£3  and  Results 


Overview 

This  chapter  discusses  the  rules  the  expert  uses  when  analyzing  the 
Monthly  Stock  Status  Report  and  some  of  the  logic  underlying  these  rules. 
The  discussion  concludes  with  the  results  of  the  verification  of  the  expert 
system. 

Findings 

The  researcher  found  the  expert  used  ten  different  decision  rules  to 
determine  five  different  management  actions.  While  some  of  the  rules  are 
based  on  the  expert's  past  experience,  some  rules  reflect  the  way 
management  wants  to  change  the  structure  of  the  inventory  account.  The 
expert  also  used  several  other  rules  to  aid  in  the  analysis  of  the  data  before 
applying  the  decision  rules.  These  rules  changed  the  raw  numerical  data 
into  a  symbolic  or  boolean  form  which  the  expert  used  in  the  decision  rules. 
These  types  of  data  transformation  occurred  during  the  following  situations; 
if  there  had  been  three  months  with  demands  in  the  past  six  months,  or  if 
demand  was  consistent  over  the  past  six  months,  if  the  item  was  recently 
added  to  the  inventory  system  and  other  such  data  transformations.  These 
transformations  were  captured  in  the  knowledge  engineering  sessions  and 
coded  into  the  expert  system  to  eliminate  human  interaction  with  the 
decision  process.  Then  the  expert  used  the  decision  rules  to  assign  one  of 
the  following  management  actions;  delete  the  item,  determine  if  prior  action 
is  required  before  deleting  a  nonrecurring  demand  item,  excess  part  of  the 
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item  inventory,  establish  an  operating  level  for  an  item,  or  to  remove  the 
unique  management  code  from  an  item  record. 

The  decision  rules  are  discussed  in  the  order  they  appear  in  the 
program.  The  order  within  the  program  minimized  rule  interaction  and 
reflects  management's  priority  of  actions  to  perform  on  the  items. 

Interaction  amongst  the  decision  rules  at  times  was  quite  prevalent  and 
often  times  an  item  met  the  criteria  in  several  rules. 

The  first  four  decision  rules  deal  with  deleting  an  item  from  the 
inventory.  These  rules  are  at  the  beginning  of  the  program  because  medical 
logistics  management  is  trying  to  reduce  the  size  of  the  inventory  due  to  a 
move  to  a  smaller  facility  in  the  future.  Management  believes  that  a  smaller 
inventory  may  relieve  some  of  the  strain  caused  by  a  dwindling  experienced 
manpower  pool  and  reduced  budgets  also  assumed  this  posture. 

The  first  rule  deletes  items  which  have  not  been  issued  for  the  past  six 
months  and  have  no  outstanding  due  ins  or  due  outs.  This  rule  deletes  items 
because  the  usage  is  not  at  a  sufficient  level  to  warrant  stockage  and  there 
is  no  pending  action  against  the  particular  stock  number.  The  low  usage 
rate  indicates  the  item  is  rarely  used  and  unless  the  item  is  critical, 
management  should  delete  the  item.  The  item  is  retained  in  the  system  if 
there  is  a  due  in  or  due  out  pending  because  most  of  the  time  they  could  not 
stop  the  shipment  from  arriving.  The  second  rule  has  similar  criteria  as 
rule  one.  This  rule  examines  items  which  have  been  in  the  system  for  six 
months.  It  recommends  these  items  be  deleted  if  there  has  only  been  demand 
for  the  month  they  entered  the  system.  Items  meeting  this  criteria  should 
probably  been  ordered  as  a  one  time  buy.  This  situation  most  likely  occurs 
because  the  customer  said  the  item  would  be  used  on  a  recurring  basis  and 
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medical  logistics  personnel  should  add  it  to  the  medical  supplies  inventory. 
Since  the  customer  requested  the  item  only  once  since  it  entered  the  system 
six  months  ago.  logistics  management  personnel  should  delete  it  because  of  its 
low  usage  and  nonrecurring  demand. 

The  item's  consumption  pattern  and  average  pipeline  time  form  the 
basis  of  the  third  deletion  rule.  If  an  item  has  low  consumption,  less  than 
0.3  units  demanded  per  month,  and  a  short  pipeline  time,  less  than  31  days, 
logistics  management  personnel  would  delete  the  item.  This  rule  deletes  all 
items  used  infrequently  with  short  lead  times.  The  consumption  rate  is 
based  on  the  expert's  experience  and  is  not  analytically  based  nor 
determined;  therefore,  this  value  may  not  be  optimal  but  is  working  well. 
The  expert  chose  31  days  as  the  cut  based  on  his  experience.  The  computer 
defaults  to  an  average  pipeline  time  of  31  days  when  it  has  insufficient  data 
to  calculate  an  average  pipeline  time.  If  the  average  pipeline  time  was  less 
than  31  days,  the  potential  to  leave  items  in  the  inventory  system  when  they 
should  be  deleted  is  increased. 

The  fourth  deletion  rule  determines  whether  the  stock  number  should 
have  even  been  loaded  in  the  system.  This  rule  looks  at  the  stock  number  to 
determine  if  it  starts  with  a  P'.  ends  with  an  IF'  or  if  the  string  'LFB'  is 
in  the  stock  number.  These  character  strings  are  appended  to  or  imbedded 
in  the  stock  number  of  items  purchased  on  a  nonrecurring  basis.  These 
numbers  usually  are  not  supposed  to  be  entered  into  the  system  because  they 
will  not  have  recurring  demand,  but  inadvertently  were  entered  into  the 
system.  This  normally  occurs  because  someone  made  a  mistake  and  entered 
the  item  as  having  a  recurring  demand.  Management  should  delete  any  stock 
number  containing  one  of  these  character  strings  unless  there  is  a  due  in  or 
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due  out  pending,  in  which  case  management  treats  the  item  differently 
before  deletion.  In  such  a  case,  the  expert  system  places  the  item  into  a 
separate  report.  This  rule  was  not  added  to  the  system  until  the  validation 
phase  because  the  expert  did  not  convey  this  information  during  the  original 
knowledge  engineering  sessions.  The  above  illustrates  the  difficulty  in 
obtaining  knowledge  from  an  expert.  Under  certain  circumstances,  the 
expert  recalls  more  form  memory  than  at  other  times. 

The  fifth  rule  of  the  expert  system  deals  with  identifying  items  to  be 
put  into  excess  status.  Items  are  placed  into  excess  status  when  the  quantity 
in  economic  retention  minus  the  number  due  out  exceeds  half  the  value  of 
the  economic  retention  level.  AFM  67-1  contains  no  guidance  as  to  when  an 
item  is  declared  in  excess  status  or  how  many  to  declare.  The  expert 
determined  the  above  criteria  would  not  allow  the  inventory  of  the  items  in 
question  to  get  too  large,  yet  would  keep  an  adequate  number  of  assets  in 
stock  to  minimize  the  loss  of  investment  cost  of  the  items.  This  situation 
usually  happens  as  demand  for  an  item  falls  off  which  lowers  the  demand 
rate.  The  lowered  demand  rate  results  in  the  computer  setting  a  lower 
operating  level  forcing  assets  in  stock  into  economic  retention  status  and 
eventually  into  excess.  If  the  demand  stays  steady  at  the  lower  rate,  the 
customers  will  eventually  use  the  items  in  economic  retention  status.  If  the 
demand  rate  becomes  too  low.  the  expert  system  will  recommend  deletion  of 
the  item  sometime  in  the  future. 

Establishing  an  operating  level  for  those  items  which  have  no 
established  operating  level  and  are  not  contract  specific  is  the  focus  of  the 
sixth  rule.  Contract  specific  items  contain  the  character  string  'CT'  at  the 
end  of  the  stock  number.  The  contracting  section  manages  these  items  and 
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hospital  logistics  management  should  take  few  if  any  actions  on  the  item 
This  situation  seemed  to  affect  only  this  rule.  This  rule  only  applies  to 
items  with  an  operating  level  of  zero  and  occurs  when  customers  order  a 
particular  quantity  of  an  item  which  is  different  from  the  quantity  unit 
pack  the  logistics  management  branch  has  to  order  from  the  supplier.  In 
this  situation,  the  logistics  management  branch  orders  more  than  the 
customer  needs  although  there  is  no  demand  for  all  the  items.  The  quantity 
due  in  will  exceed  the  quantity  due  out.  The  operating  level  of  zero  occurs 
because  the  person  entering  the  data  into  the  inventory  system  does  not 
recognize  what  is  happening  or  forgets  to  establish  an  operating  level  for 
the  item.  The  action  portion  of  this  rule  determines  whether  a  daily  demand 
rate  has  been  established  for  the  item.  If  the  item  has  a  daily  demand  rate, 
the  expert  system  suggests  an  operating  level  of  ninety  times  the  demand 
level,  or  a  three  month  supply  The  expert  suggested  this  operating  level, 
which  should  provide  enough  assets  to  cover  one  month  lead  time,  one  month 
of  demand,  and  one  month  of  safety  stock.  If  no  demand  level  has  been 
established,  the  expert  system  suggests  an  operating  level  equal  to  the 
difference  between  what  is  due  in  and  due  out. 

The  next  three  rules  determine  if  the  U  management  code  should  be 
removed  from  the  item  record.  Management  places  this  code  on  an  item 
record  when  they  wish  to  manually  review  and  control  the  asset.  This 
situation  usually  happens  when  an  item  enters  the  system  or  the  customer 
requests  the  logistics  management  personnel  to  delete  the  item  from  the 
medical  supplies  inventory.  When  an  item  enters  the  system,  management 
overrides  the  computer  generated  operating  level  with  one  they  deem  more 
appropriate  and  they  place  the  U  code  on  the  item.  The  U  code  acts  as  a  flag 
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causing  the  computer  to  print  the  item  in  the  Monthly  Stock  Status  Report: 
therefore  allowing  management  to  manually  review  the  record.  If  an  item 
entered  the  inventory  less  than  six  months  ago  and  has  at  least  three  months 
with  demands,  logistics  management  personnel  should  remove  the  U 
management  code.  This  indicates  the  customer  demands  for  the  item  are  at 
an  acceptable  and  steady  level.  Management  should  also  remove  this  code  if 
the  item  entered  the  system  more  than  six  months  ago  but  less  than  12  months 
ago.  By  this  time,  the  computer  generated  operating  level  is  usually  the 
same  as  the  operating  level  deemed  appropriate  by  management. 

The  third  way  to  remove  a  U  management  code  is  when  the  demand  is 
consistent  over  the  past  six  months,  the  item  is  old,  and  the  demand  in  the 
last  six  months  is  less  than  half  of  the  demand  of  the  previous  six  months. 
Inventory  management  will  place  a  U  management  code  on  an  item  record 
when  a  customer  requests  the  item  to  be  deleted  from  the  inventory  account. 
This  is  done  to  give  the  item  visibility  and  to  determine  if  there  are  other 
users  of  the  item.  If  demand  for  the  item  continues  and  the  demand  is 
consistent,  the  U  code  will  be  removed.  Demand  for  an  item  is  consistent  if 
in  the  past  six  months  there  were  no  two  months  in  a  row  with  no  demand 
and  the  demand  in  any  given  month  is  less  than  the  operating  level.  If  there 
are  no  other  users  of  the  item,  management  will  delete  the  item  when  six 
months  have  passed  with  no  demands  placed  on  the  item. 

The  last  decision  rule  deals  with  checking  dates  of  certain  dated  items. 

If  the  on  hand  serviceable  balance  of  a  dated  item  exceeds  the  operating 
level,  the  expert  system  flags  this  item  so  someone  can  check  the  expiration 
date.  This  rule  is  necessary  because  as  the  demand  of  a  dated  item  declines, 
there  is  the  possibility  that  the  item  will  exceed  its  expiration  date  before  it 
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IS  issued.  This  rule  does  not  differentiate  between  the  different  types  of 
dated  items  and  makes  no  other  recommendation  other  than  to  check  the 
expiration  date. 

The  expert  system  had  two  more  rules  which  were  added  for  the  sake 
of  good  programming  practices.  The  first  added  rule  checked  to  see  if  an 
item  had  either  a  demand  in  the  past  six  months,  a  due  in  or  due  out.  Any 
items  fitting  this  criteria  were  given  an  action  of  ok.’  If  there  were  any 
items  which  did  not  fit  any  of  the  criteria  outlined  by  the  previous  rules, 
the  expert  system  gave  that  item  an  action  of  unknown.'  The  expert  system 
printed  the  items  with  an  action  of  unknown  on  a  separate  report.  This 
allowed  the  inventory  managers  visibility  of  any  items  the  expert  system  did 
not  know  how  to  handle.  In  all  the  validation  and  verification  tests,  this  last 
rule  was  never  activated  by  an  item. 

Table  3  lists  the  decision  rules  as  they  are  found  in  the  expert  system. 


Table  3 

Expert  System  Decision  Rules 


Rule  Description 

Delete  items  with  no  issues  in  past  six  months 

Delete  new  items  with  no  issues  in  past  five  months 

Delete  items  with  low  consumption  and  short  pipeline  time 

Delete  one  time  buy  items 

Place  items  into  excess  status 

Establish  operating  level 

Remove  U  code  for  new  items  with  three  demands  in  past  6 
months 

Remove  U  code  for  new  items  in  system  for  more  than  six 
months 

Remove  U  for  old  items  with  another  user 
Check  date  on  dated  items 
Determine  items  that  are  ok 
Unknown 


Rule  No. 

1 

2 

3 

5 

6 


8 

9 

10 
11 
12 


Results 


The  expert  system  applied  the  rules  discussed  above  to  15  sets  of 
validation  data,  and  the  researcher  compared  these  results  to  the  answers 
prepared  by  the  expert  for  the  same  data.  Refer  to  Appendix  E  for  a  listing 
of  the  decisions  made  for  each  data  set.  Discrepancies  were  not  verified  at 
this  point  in  the  analysis.  Table  4  shows  the  results  of  this  analysis. 

Table  4 

Results  Without  Verification  of  Decision  Discrepancies 


Correct 

Responses 

1 

49 

1.000 

0.3222 

fail  to  reject 

2 

43 

2.824 

0.0068 

reject 

3 

40 

3.500 

0.0010 

reject 

4 

44 

2.585 

0.0128 

reject 

5 

46 

2.064 

0.0443 

reject 

6 

39 

3.718 

0.0005 

reject 

7 

43 

2.824 

0.0068 

reject 

8 

44 

2.585 

0.0128 

reject 

9 

42 

3.055 

0.0036 

reject 

10 

45 

2.333 

0.0238 

reject 

11 

40 

3.500 

0.0010 

reject 

12 

40 

3.500 

0.0010 

reject 

13 

47 

1.769 

0.0832 

fail  to  reject 

14 

44 

2.585 

0.0128 

reject 

15 

43 

2.824 

0.0068 

reject 

95%  confidence  interval  43.267  ±  1.559 


This  table  shows  the  expert  system  made  the  correct  decision  on 
average  43  times  out  of  50.  or  86%  of  the  time.  The  t-test  results  indicate 
rejection  of  the  hypothesis  that  the  expert  system  performs  as  well  as  the 
human  expert  is  warranted. 
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These  test  results  led  the  researcher  to  verify  the  discrepancies  with 
the  human  expert.  The  researcher  then  found  the  human  expert  often  forgot 
to  apply  one  or  more  of  the  decision  rules.  The  expert  confirmed  that  often 
it  was  hard  to  concentrate  because  of  frequent  interruptions  or  because  he 
was  tired.  Sometimes  he  just  made  a  mistake  because  he  did  not  review  all 
pertinent  data.  This  verification  process  added  validity  to  the  expert  system. 
This  increased  validity  was  obtained  because  the  expert  sometimes  changed 
his  decision  when  confronted,  and  the  expert  system  chose  the  new  decision 
from  the  outset.  The  expert  changed  his  decision  usually  when  he  took  into 
account  all  of  the  data  provided  and  came  to  a  less  than  optimal  decision. 
After  the  discrepancies  were  verified,  the  following  results  were  obtained: 


Table  5 

Results  With  Verification  of  Decision  Discrepancies 


Correct  2  tail 

Sample  Set  Responses  t  Value  t  Probability  Conclusion 


1 

50 

• 

• 

fail  to  reject 

2 

49 

1.000 

0.3222 

fail  to  reject 

3 

49 

1.000 

0.3222 

fail  to  reject 

4 

50 

• 

• 

fail  to  reject 

5 

48 

1.429 

0.1594 

fail  to  reject 

6 

49 

1.000 

0.3222 

fail  to  reject 

7 

50 

• 

• 

fail  to  reject 

8 

50 

• 

• 

fail  to  reject 

9 

49 

l.OOO 

0.3222 

fail  to  reject 

10 

50 

• 

• 

fail  to  reject 

11 

50 

• 

• 

fail  to  reject 

12 

49 

1.000 

0.3222 

fail  to  reject 

13 

50 

• 

• 

fail  to  reject 

14 

49 

1.000 

0.3222 

fail  to  reject 

15 

50 

• 

• 

fail  to  reject 

95%  confidence  interval  49.5  »  0.354 
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These  results  indicate  the  expert  system  performs  very  well.  In  fact, 
the  expert  system  made  the  correct  decision  99%  of  the  time.  The  t-test 
indicates  failure  to  reject  the  null  hypothesis  that  the  expert  system  makes 
the  same  decisions  as  the  human  expert.  Therefore,  it  is  reasonable  to 
assume  the  expert  system  made  the  same  decisions  as  the  human  expert  for 
the  verification  data  sets  because  the  t-test  did  not  reject  the  null 
hypothesis. 

One  interesting  note  about  the  decisions  that  the  expert  system  and  the 
human  expert  did  not  agree  on,  is  most  of  these  items  should  have  had  some 
action  taken  upon  them  at  some  time  in  the  past.  The  expert  system  was  not 
programmed  to  find  these  items  and  most  of  the  time,  the  expert  system 
would  have  made  the  same  decision  as  the  human  expert  in  the  previous 
month.  Most  of  the  items  fell  into  one  of  two  decision  categories.  The  first 
situation  was  when  an  old  item  had  a  U  management  code  in  the  item  record 
and  the  item  was  being  used  at  a  consistent  rate.  The  human  expert 
concluded  the  U  code  should  be  removed  and  the  expert  system  determined 
the  item  was  ok.  This  disparity  occurred  because  the  expert  system  was  not 
programmed  to  remove  U  codes  from  old  records  which  had  consistent 
demand  data  over  the  past  year.  The  second  decision  category  was  old  items 
with  a  demand  the  previous  month,  but  with  no  other  or  very  few  demands 
for  the  rest  of  the  year.  In  this  circumstance  the  human  expert  concluded 
the  item  should  be  deleted  and  the  expert  system  concluded  the  item  was  ok. 
The  expert  system  reached  this  decision  because  the  item  record  data  did  not 
fit  the  criteria  for  the  deletion  rules,  but  did  for  the  ok  rule.  When  this 
situation  occurred,  it  was  noticed  that  generally  the  expert  system  would 
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have  deleted  the  item  the  previous  month  which  would  have  agreed  with  the 
decision  the  human  expert. 


Summary 

This  chapter  discussed  the  decision  rules  the  human  expert  used  to 
determine  management  actions  on  items  in  the  medical  inventory  system. 
The  discussion  also  included  those  rules  used  to  transform  the  raw 
numerical  data  into  a  more  symbolic  form.  Following  these  rules  was  a 
short  discussion  of  the  results  of  the  verification  process  of  the  expert 
system.  The  results  of  the  verification  process  indicated  the  expert  system 
was  more  consistent  in  the  decisions  it  made  than  the  decisions  made  by  the 
human  expert.  The  next  chapter  discusses  the  conclusions  we  can  draw 
from  the  findings  and  results  outlined  in  this  chapter. 
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V. 


Overview 

This  chapter  briefly  outlines  the  investigative  questions  of  this 
research,  the  methodology  used  for  the  research  and  the  research  findings. 
The  discussion  answers  the  investigative  questions  and  draws  conclusions 
from  the  findings  and  results  presented  in  chapter  four.  This  discussion  is 
followed  by  a  short  section  on  areas  that  might  be  of  interest  for  further 
research. 

Summary  of  Research  Effort 

This  section  briefly  discusses  the  research  objective,  the  methodology 
used  to  achieve  this  objective  and  the  findings  and  results  from  applying  the 
methodology. 

Research  Objective.  The  objective  of  this  research  was  to  discover  the 
reasoning  process  of  hospital  inventory  management  experts.  This 
knowledge  was  used  to  develop  an  expert  system  to  help  junior  NCOs  to 
make  the  same  decisions  as  the  inventory  expert  in  an  effort  to  help 
alleviate  some  of  the  budget  constraints  and  manpower  shortages  the 
WPAFB  Medical  Logistics  Management  Branch  is  experiencing.  The  other 
reason  for  doing  this  research  was  to  record  the  knowledge  which  is  fairly 
well  known  now  in  a  medium  which  can  be  readily  accessed  in  the  future 
when  most  people  have  forgotten  the  underlying  processes  of  the  computer 
programs  they  run  every  day.  Thus,  the  underlying  objective  of  this 
research  was  to  expand  the  knowledge  base  of  inventory  managers. 
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Research  Methodology.  The  research  was  conducted  in  three  phases: 
knowledge  acquisition,  system  development,  and  system  validation.  The 
knowledge  acquisition  phase  consisted  of  domain  familiarization  and  the 
actual  knowledge  acquisition  interviews.  During  the  system  development 
stage,  the  knowledge  was  analyzed  and  problem  patterns  began  to  emerge. 
This  knowledge  was  translated  into  a  computer  code  in  a  piece  wise  fashion. 
As  each  problem  area  was  added,  the  system  was  verified  to  ensure  minimal 
interactions  of  the  variables.  Once  all  the  problem  areas  were  encoded, 
system  validation  was  accomplished.  During  this  phase  of  the  research.  15 
stratified  random  samples  of  actual  data  were  analyzed  using  the  expert 
system  and  the  human  expert.  The  expert  system  answers  were  compared 
and  verified  with  those  of  the  inventory  expert.  This  phase  of  the  research 
was  necessary  to  verify  that  the  expert  system  contained  and  applied  the 
human  expert's  knowledge  correctly. 

Research  Findings.  It  was  found  during  the  course  of  the  research  that 
the  expert  used  ten  different  rules  to  determine  five  different  possible 
management  actions.  In  the  course  of  reaching  a  decision,  the  expert  often 
converted  the  raw  numerical  data  into  a  more  symbolic  form.  During  the 
expert  system  validation  phase,  it  was  found  that  the  expert  system  provided 
more  consistent  results  than  the  human  expert.  This  was  revealed  when  the 
discrepancies  between  the  expert  system  and  the  human  expert  were 
verified  and  the  human  expert  realized  he  did  not  look  at  all  of  the  data  or 
had  made  a  mistake.  Once  the  discrepancies  were  verified,  the  expert 
system  made  the  correct  decision  over  49  times  out  of  50.  A  listing  of  the 
rules  can  be  found  in  Table  3. 
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The  following  conclusions  are  directly  based  on  the  investigative 
questions  forming  the  framework  for  this  research. 

Investiflative  Question  i:  What  type  of  reasoning  strategies  do  hospital 
inventory  management  experts  use  to  solve  inventory  problems? 

Conclusion  1.  Hospital  inventory  managers  use  heuristic  reasoning 
based  on  their  past  experience  and  intuition.  There  is  little  guidance 
provided  in  AFM  67-1  or  in  local  policy  letters  on  the  types  of  decisions 
being  made  on  the  Monthly  Stock  Status  Report.  This  forces  the  inventory 
managers  to  rely  on  their  past  experience  and  intuition  when  dealing  with 
management  problems.  Secondly,  they  are  not  using  any  type  of  algorithmic 
process  to  determine  if  the  criteria  set  forth  in  the  decision  rules  is  optimal 
or  any  type  of  post  analysis  to  determine  if  the  decision  made  based  upon 
the  item  leveling  data  is  optimal.  The  inventory  management  experts  have 
found  that  over  a  long  period  of  time,  the  criteria  in  the  decision  rules 
works  well  enough  most  of  the  time.  This  does  not  imply  that  the  decisions 
are  correct  all  of  the  time  or  even  that  they  are  optimal,  but  that  most  of  the 
time  they  are  acceptable. 

Ir vestigative  Question  2:  If  the  experts  u^e  heuristic  reasoning: 

A.  Can  the  researcher  generalize  the  specific  heuristics  for  possible 
use  in  solving  other  types  of  problems? 

B.  Can  the  researcher  verify  the  heuristic  reasoning  by  building  an 
expert  system? 

C.  Does  the  expert  system  make  the  same  decisions  as  the  human 
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Conclusion  2:  The  heuristics  used  bv  the  WPAFB  Medical  Logistics 
Management  Branch  can  be  generalized  for  possible  use  in  solving  other 
types  q£  problems.  Time,  consistency  of  use.  determination  of  low 
consumption  and  when  to  let  the  computer  track  items  are  four  of  the  most 
useful  generalized  heuristics  resulting  from  this  research.  These 
generalizations  were  taken  from  the  rules  for  the  expert  system  and 
discussions  with  the  expert. 

Generalization  i;  Six  time  periods  provide  an  adequate  history  to 
base  decisions  on  for  dynamic  situations.  A  larger  number  of  time  periods 
may  allow  more  accurate  decisions,  but  the  loss  of  timeliness  may  cost  more 
in  the  long  run.  While  a  smaller  number  of  time  periods  would  provide 
better  timeliness,  the  short  history  may  not  provide  enough  data  to 
determine  accurate  trends  causing  err-oneous  decisions.  There  is  no  set 
length  of  time  that  makes  up  a  time  period,  though  the  time  period  must  be 
consistent  across  the  analysis.  Also  note  that  the  more  dynamic  a  situation 
is.  the  shorter  the  time  period  can  be  to  ensure  timeliness  of  the  decision. 
The  rules  in  the  expert  system  frequently  used  six  months  as  the  basis  of  the 
decision. 

Generalization  Z:-  Consistency  of  demand  or  usage  is  often 
important.  If  the  situation  is  characterized  by  a  Poisson  distribution  with  a 
mean  significantly  different  than  zero,  it  is  consistent  if  a  demand  occurs  at 
least  every  other  time  period  and  does  not  exceed  a  reasonable  value  within 
the  past  six  time  periods.  When  the  mean  is  close  to  zero,  the  number  of 
consecutive  time  periods  with  no  demand  must  be  increased.  This  is  because 
a  demand  of  one  unit  must  be  averaged  over  a  greater  number  of  time 
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periods  to  approximate  the  mean.  The  reasonable  value  must  be  set  by 
management  and  is  usually  some  fraction  of  total  possible  output. 

Generalization  3:  Low  demand  or  usage  in  a  dynamic  environment 
is  characterized  by  a  rate  of  less  than  0.3  per  time  period.  This  could  vary 
according  to  the  length  of  the  time  period  and  the  rate  of  demand.  Usually 
an  event  is  not  given  much  weight  in  a  dynamic  environment  if  it  has  a  less 
then  one-third  chance  of  happening.  In  these  situations,  one  would  truly  be 
run  over  by  the  elephants  while  he  was  taking  care  of  the  ants. 

Generalization  4;  If  there  is  an  automated  tracking  system,  allow 
it  to  track  events  which  occur  three  out  of  six  time  periods.  Usually 
automated  tracking  systems  need  fairly  consistent  data  and  a  good  history  of 
the  event.  Six  time  periods  of  data  usually  gives  a  good  indication  of  the 
frequency  of  the  event  for  a  good  forecast.  If  the  event  occurs  more 
frequently,  fewer  time  periods  are  usually  needed. 

Conclusion  3.:  The  researcher  was  able  to  build  an  expert  system  from 
the  knowledge  obtained  from  the  knowledge  engineering  sessions.  The 
researcher  built  two  expert  systems.  The  first  one  was  done  in  VP  Expert, 
which  asks  the  user  questions  to  determine  what  action  to  take.  A  listing  of 
this  program  is  in  Appendix  F.  The  user  inputs  the  response  when 
prompted.  If  the  user  does  not  know  why  the  expert  system  is  asking  him  a 
certain  question,  he  can  ask  the  system  why  it  needs  to  know  that  piece  of 
information.  The  user  can  also  ask  for  help  to  determine  the  criteria  used  to 
convert  the  numerical  data  into  a  more  symbolic  form.  This  particular 
system  was  designed  to  be  a  tutorial. 

The  second  expert  system  was  done  in  dBase  III*.  The  listing  for  this 
program  is  in  Appendix  G.  This  expert  system  uses  an  unparsed  ASCII  file 
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as  input,  and  produces  a  dBase  Tile  as  output.  This  expert  system  uses  the 
exact  same  rule  set  as  the  VP  Expert  program,  but  has  minimal  interface 
with  the  user.  This  program  has  a  short  optional  instruction  screen  before 
asking  the  user  for  the  input  file  and  the  name  of  the  output  file  it  should 
create.  Once  this  system  completes  the  decision  making  process,  it  prints  the 
results  to  a  line  printer  rather  than  the  screen.  A  sample  of  the  output  is  in 
Appendix  H.  The  dBase  expert  system  does  not  delete  the  output  file,  which 
can  be  used  to  perform  management  specific  queries  not  in  the  expert 
system  reports  generator  by  accessing  the  output  file  using  dBase  III*. 

Conclusion  4 ;  The  expert  system  made  the  same  decisions  as  the  human 
expert  and  in  some  cases  performed  better  than  the  human  expert.  Table  5 
shows  there  is  no  significant  difference  in  the  decisions  the  expert  system 
made  versus  the  de  .,ions  made  by  the  human  expert  for  the  fifteen 
verification  data  sets.  In  fifteen  data  sets,  the  expert  system  made  the  same 
decision  49.4  *  .4  times  out  of  fifty  at  a  95  percent  confidence  level  as  the 
human  expert  would.  In  fact,  the  expert  system  was  more  consistent  than 
the  human  expert  due  to  human  error. 

Re^commendations  for  Future  Research 

This  research  broadened  the  knowledge  base  of  the  application  of 
expert  systems  to  the  field  of  logistics  management.  The  research  also 
revealed  several  other  areas  which  should  be  studied  further  to  enhance  the 
body  of  published  knowledge.  These  areas  include  other  areas  of  logistics 
management  burdened  with  computer  listings  which  presently  require 
human  analysis,  the  long  term  use  and  effectiveness  of  expert  systems,  and 
further  research  on  the  application  of  expert  systems  to  inventory  control. 
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The  logistics  management  arena  offers  numerous  opportunities  to  apply 
expert  systems.  Over  the  years  as  researchers  enhanced  computer  data 
storage  capabilities,  the  number  of  reports  managers  review  increased 
dramatically.  Most  of  ihese  reports  are  excellent  candidates  for  the 
application  of  an  expert  system  even  though  it  may  not  be  a  very  large 
project.  It  is  very  likely  a  researcher  could  build  an  expert  system  that 
analyzes  several  reports  since  many  reports  may  share  a  common  database. 

In  this  case,  a  significant  amount  of  data  preparation  could  be  eliminated 
while  creating  a  much  more  meaningful  and  comprehensive  report. 

Freeing  managers  of  the  burden  of  reviewing  volumes  of  computer 
generated  reports  to  make  basic  everyday  decisions  would  impact  office 
effectiveness  and  efficiency.  The  use  of  expert  systems  would  free 
managers  to  solve  larger  more  complex  problems  making  them  more 
effective.  Since  an  expert  system  would  very  possibly  arrive  at  a  decision 
faster  than  the  manager  could  manually,  the  manager’s  efficiency  could  very 
well  be  increased.  Efficiencies  could  also  be  increased  dramatically  if  the 
expert  system  transfers  its  solutions  back  to  the  computer  which  supplied 
the  data  as  an  automated  input  for  problem  correction.  In  this  way,  human 
intervention  is  not  needed  and  the  system  would  react  automatically  to 
known  problem  conditions. 

A  more  intriguing  question  to  research  is  what  happens  to  expert 
systems  once  they  are  implemented  and  in  service  for  an  extended  period  of 
time?  There  has  been  little  research  done  on  the  updating  and  extended  use 
of  expert  systems.  This  allows  for  much  debate  over  who  should  update  the 
knowledge  base  of  an  expert  system,  the  developer  or  the  end  user?  The 
end  user  usually  has  the  expert  knowledge  to  update  the  system,  but  not  the 
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programming  knowledge.  The  reverse  is  true  for  the  developer  who  usually 
builds  the  system  on  contract.  This  leads  to  another  important  area  for 
further  research,  how  many  expert  systems  are  not  being  used  because  the 
knowledge  they  contain  is  old  and  no  longer  valid?  Many  expert  systems 
have  been  built  in  the  recent  past  and  were  readily  accepted  by  the 
management  community.  As  the  environment  changes  and  policies  are 
updated,  have  the  expert  systems  been  enhanced  to  reflect  these  changes  or 
have  they  fallen  by  the  wayside  because  they  no  longer  perform  the 
function  required  by  management?  The  answer  to  this  question  can  affect 
the  future  design  of  expert  systems  and  further  define  when  it  is  effective 
to  build  an  expert  system.  Design  changes  could  very  well  be  aimed  at 
easing  the  updating  mechanism  ot  the  expert  system  by  the  user. 

More  research  needs  to  be  done  in  the  area  of  expert  systems  and 
inventory  control.  The  two  main  areas  for  research  within  this  broad  topic 
are  capturing  the  knowledge  of  inventory  control  practices  and  integrating 
the  expert  systems  developed  from  this  knowledge  into  the  inventory  control 
computer  to  increase  the  computer  automation  of  the  process.  The  just 
completed  research  looked  m'^inly  at  deleting  items  from  the  inventory.  An 
area  just  as  important  which  needs  to  be  researched  is  when  to  increase 
levels  of  items  already  in  the  inventory.  Many  times  demand  for  items  rises 
over  time  causing  shortages  within  the  supply  system.  If-  the  knowledge 
surrounding  this  situation  was  captured  and  refined  into  an  expert  system, 
inventory  systems  might  react  quicker  to  this  situation  and  thus  there  would 
be  an  increase  in  customer  service  levels.  Presently.  WPAFB  medical 
logistics  management  does  not  review  the  Monthly  Stock  Status  Report  or 
search  the  inventory  database  for  this  situation. 
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Another  area  worthy  of  research  is  the  application  of  an  expert  system 
for  inventory  control  in  a  just-in-time  environment.  With  the  pressures  to 
reduce  costs,  many  managers  are  cutting  their  overhead  by  moving  into 
smaller  warehouses,  reducing  inventories,  and  going  to  a  just-in-time 
inventory  policy.  The  management  of  inventories  becomes  paramount  in 
this  environment.  There  is  less  margin  of  error  and  system  reaction  must  be 
faster.  With  the  number  of  items  stocked  in  any  company,  an  expert  system 
should  reduce  the  effort  required  to  manage  the  inventory  system. 

To  further  reduce  the  effort  required  to  manage  inventory  systems,  the 
expert  systems  developed  to  run  on  microcomputers  should  be  integrated  into 
the  inventory  mainframe  computer.  Many  expert  systems  print  reports 
which  indicate  the  action  to  be  taken,  but  an  operator  still  has  to  input  these 
actions  into  another  computer.  It  would  be  well  worth  the  research  effort 
to  determine  if  expert  systems  now  in  existence  could  be  integrated  into  the 
host  mainframe  computer  to  reduce  operator  interface.  This  should  result  in 
faster  updating  of  vital  inventory  records  with  increased  accuracy.  This 
would  allow  the  management  of  inventory  systems  to  be  almost  completely 
automated. 

Summary 

Expert  systems  have  an  impact  on  the  way  managers  conduct  their 
business.  They  allow  most  anyone  to  make  the  same  decisions  as  a  seasoned 
expert  in  the  area  for  which  they  were  developed.  As  managers  develop 
more  computer  programs  to  make  life  easier,  one  fact  is  often  overlooked. 
People  are  becoming  more  dependent  upon  computers  and  view  the 
computer  processes  as  a  black  box.  As  this  happens,  people  will  become  less 
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aware  of  the  heuristics  and  knowledge  behind  the  computerized  process. 
Therefore,  managers  must  not  let  the  knowledge  they  possess  be  forgotten  or 
lost  in  some  computer  program  where  subordinates  would  have  a  hard  time 
recreating  and  understanding  the  process.  Expert  systems  are  a  unique  type 
of  computer  program  which  not  only  make  life  easier  through  computer 
automation,  but  can  also  explain  the  process  they  perform  filling  the 
knowledge  gap  which  would  otherwise  exist. 
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Appendix  A:  Monthly  Stock  Status  Report 

The  following  page  is  a  copy  of  an  annotated  page  from  the  Monthly  StQgls 
Status  Report  dated  1  Oct  90. 
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Appendix  B:  Level  Data  Fite 


Column 

Field  Lenath 

Field  Name 

Field  Tvoe 

1  -  4 

4 

SRAN 

Numeric 

5  -  19 

15 

NSN 

Alphanumeric 

20 

1 

Expendability  Code 

Numeric 

21  -  45 

25 

Nomenclature 

Alphanumeric 

46 

1 

Dated  Item  Code 

Numeric 

47 

1 

Delete  Code 

Alpha 

48  -  49 

2 

PSM 

Alphanumeric 

50 

1 

Function  Identifier 

Alpha 

51  -  58 

8 

Price  (multiplied  x  100) 

Numeric 

59  -  60 

2 

Unit  of  Issue 

Alpha 

61 

1 

Requirement  Code 

Numeric 

62  -  63 

2 

Reorder  7o 

Numeric 

64  -  66 

3 

Avg  Pipeline  Time 

Numeric 

67  -  70 

4 

1st  Pipeline  Date 

Numeric 

71  -  74 

4 

1st  Pipeline  days 

Numeric 

75  -  78 

4 

2nd  Pipeline  Date 

Numeric 

79  -  82 

4 

2nd  Pipeline  days 

Numeric 

83  -  86 

4 

3rd  Pipeline  Date 

Numeric 

87  -  90 

4 

3rd  Pipeline  days 

Numeric 

91  -  94 

4 

4th  Pipeline  Date 

Numeric 

95  -  98 

4 

4th  Pipeline  days 

Numeric 

99  -  102 

4 

5th  Pipeline  Date 

Numeric 

103  -  106 

4 

5th  Pipeline  days 

Numeric 

107  -  110 

4 

6th  Pipeline  Date 

Numeric 

111  -  114 

4 

6th  Pipeline  days 

Numeric 

115  -  120 

6 

DDR  (multiplied  x  1000) 

Numeric 

121  -  124 

4 

History  Begin  Date 

Numeric 

125 

1 

Unique  Code 

Alpha 

126  -  131 

6 

Control  Level 

Numeric 

132  -  137 

6 

Operating  Level 

Numeric 

138  -  143 

6 

Excess  Qty 

Numeric 

144  -  149 

6 

Due  In  Qty 

Numeric 

150  -  155 

6 

Due  Out  Qty 

Numeric 

156  -  161 

6 

Jan  Issues 

Numeric 

162  -  167 

6 

Feb  Issues 

Numeric 

168  -  173 

6 

Mar  Issues 

Numeric 

174  -  179 

6 

Apr  Issues 

Numeric 

180  -  185 

6 

May  Issues 

Numeric 

186  -  191 

6 

Jun  Issues 

Numeric 

192  -  197 

6 

Jut  Issues 

Numeric 

198  -  203 

6 

Aug  Issues 

Numeric 

204  -  209 

6 

Sep  Issues 

Numeric 

210  -  215 

6 

Oct  Issues 

Numeric 

216  -  221 

6 

Nov  Issues 

Numeric 

222  -  227 

6 

Dec  Issues 

Numeric 
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ColumnField  Length 


Field  Name 


228  -  229  6 

230  -  231  6 


Month  Rpt  Downloaded 
Year  Rpt  Downloaded 


Field  Type 

Numeric 

Numeric 
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Appendix  C:  Sample  Size  Determination 

Preliminary  screening  of  three  months  of  leveling  data  using  a  prototype 
of  the  expert  system,  the  following  results  were  obtained; 


Month  1 

Month  2 

Month  3 

*  of  actions 

2270 

2280 

2874 

Total  records 

6177 

6085 

6660 

This  results  in  a  mean  numoer  of  actions  of  2. -475  with  a  standard 
deviation  of  3-46.  The  researcher  deemed  the  expert  system  should  detect  the 
expected  average  number  of  inventory  problems  within  an  interval  of  5%  or 
12*4  records.  This  is  to  be  done  with  a  95%  percent  confidence  factor.  This 
results  in  the  following; 

S  =  346 

d-  «  (124  /  1.95) 

n  =  (s  /  +  1 

n  =  30.606 

Though  the  equations  indicate  a  sample  size  of  31  is  adeouate.  a  sample 
Size  of  50  was  used  to  account  for  any  variations  in  the  sample  estimates. 
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Appendix  D:  Random  Samples 


The  following  data  sets  were  used  to  validate  the  expert  system.  The 
month  each  data  set  was  created  is  the  first  month  identified  after  the 
history  begin  date  field.  The  random  data  sets  were  generated  over  a  period 
of  time  and  some  fields  are  slightly  different.  In  some  data  sets  the 
operating  level  was  adjusted  not  to  exceed  the  control  level  and  some  data 
sets  have  a  negative  economic  retention  level.  This  results  from  the 
economic  retention  level  having  to  be  calculated  within  the  expert  sytem 
and  was  not  changed  to  zero.  These  anomalies  within  the  data  sets  had  no 
effect  on  the  decisions  made  by  the  expert  system  and  were  corrected  in  the 
expert  system  to  avoid  confusion  in  the  printed  reports. 
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Raridocn  SamplA  15  (cont 
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Appendix  E:  Expert  aM  System  Decisions 


Random  Sample  1  Decisions 


Item 

EapfeCt  Decision 

Verified  Decision 

System  Decision 

1 

ok 

ok 

ok 

2 

ok 

ok 

ok 

3 

ok 

ok 

ok 

4 

ok 

ok 

ok 

5 

ok 

ok 

ok 

6 

ok 

ok 

ok 

7 

check  date 

check  date 

check  date 

8 

delete 

delete 

delete 

9 

check  date 

check  date 

check  date 

10 

check  date 

check  date 

check  date 

11 

ok 

ok 

ok 

12 

ok 

ok 

ok 

13 

ok 

ok 

ok 

14 

delete 

delete 

delete 

15 

ok 

ok 

ok 

16 

ok 

ok 

ok 

17 

ok 

delete 

delete 

1$ 

ok 

ok 

ok 

19 

remove  U 

remove  U 

remove  U 

20 

ok 

ok 

ok 

21 

ok 

ok 

ok 

22 

ok 

ok 

ok 

23 

ok 

ok 

ok 

24 

ok 

ok 

ok 

25 

delete 

delete 

delete 

26 

ok 

ok 

ok 

27 

delete 

delete 

delete 

2$ 

ok 

ok 

ok 

29 

ok 

ok 

ok 

30 

delete 

delete 

delete 

31 

ok 

ok 

ok 

32 

ok 

ok 

ok 

33 

ok 

ok 

ok 

34 

remove  U 

remove  U 

remove  U 

35 

ok 

ok 

ok 

36 

ok 

ok 

ok 

37 

ok 

ok 

ok 

38 

delete 

delete 

delete 

39 

ok 

ok 

ok 

40 

ok 

ok 

ok 

41 

delete 

delete 

delete 

42 

ok 

ok 

ok 

43 

ok 

ok 

ok 

121 


Random  Sample  1  Decisions  (cont.) 


Item 

Expert  Dec.isiQii 

Verified  Decision 

System  Decision 

44 

ok 

ok 

ok 

45 

ok 

ok 

ok 

46 

ok 

ok 

ok 

41 

delete 

delete 

delete 

*48 

delete 

delete 

delete 

49 

delete 

delete 

delete 

50 

delete 

delete 

delete 

122 


Random  Sample  2  Decisions 


Item 

Exnert  Decision 

Verified  Decision 

Svstem  Decision 

1 

delete 

delete 

delete 

2 

delete 

delete 

delete 

3 

check  date 

check  date 

check  date 

4 

check  date 

check  date 

check  date 

5 

ok 

ok 

ok 

6 

ok 

ok 

ok 

7 

check  date 

check  date 

check  date 

8 

ok 

ok 

ok 

9 

ok 

ok 

ok 

10 

ok 

ok 

ok 

11 

ok 

ok 

ok 

12 

ok 

ok 

ok 

13 

ok 

ok 

ok 

14 

ok 

ok 

ok 

15 

delete 

ok 

ok 

16 

check  date 

check  date 

check  date 

17 

ok 

ok 

ok 

18 

check  date 

check  date 

check  date  - 

19 

ok 

ok 

ok 

20 

ok 

ok 

ok 

21 

ok 

delete 

delete 

22 

ok 

ok 

ok 

23 

ok 

ok 

ok 

24 

ok 

ok 

ok 

25 

ok 

ok 

ok 

26 

ok 

ok 

ok 

27 

ok 

delete 

delete 

28 

delete 

delete 

delete 

29 

ok 

ok 

ok 

30 

ok 

ok 

ok 

31 

remove  U 

remove  U 

ok 

32 

ok 

ok 

ok 

33 

ok 

ok 

ok 

34 

delete 

delete 

delete 

35 

remove  U 

remove  U 

remove  U 

36 

remove  U 

remove  U 

remove  U 

37 

delete 

delete 

delete 

38 

delete 

ok 

ok 

39 

ok 

remove  U 

remove  U 

40 

ok 

ok 

ok 

41 

ok 

ok 

ok 

42 

ok 

ok 

ok 

43 

ok 

ok 

ok 

44 

ok 

ok 

ok 

45 

delete 

delete 

delete 

46 

delete 

delete 

delete 

47 

ok 

ok 

ok 

48 

ok 

ok 

ok 

123 


Random  Sample  2  Decisions  (cont.) 


Expert  Decision 

Verified  Decision 

System  Dccisipn 

49 

p  report 

p  report 

p  report 

50 

delete 

delete 

delete 

124 


Random  Sample  3  Decisions 


Item 

Exoert  Decision 

Verified  Decision 

Svstem  Decision 

1 

delete 

delete 

delete 

2 

ok 

ok 

ok 

3 

ok 

ok 

ok 

4 

delete 

check  date 

check  date 

5 

ok 

delete 

delete 

6 

ok 

check  date 

check  date 

7 

ok 

ok 

ok 

8 

ok 

ok 

ok 

9 

ok 

ok 

ok 

10 

check  date 

check  date 

check  date 

11 

ok 

ok 

ok 

12 

ok 

ok 

ok 

13 

ok 

ok 

ok 

14 

ok 

ok 

ok 

15 

ok 

check  date 

check  date 

16 

remove  U 

check  date 

check  date 

17 

ok 

delete 

delete 

18 

ok 

ok 

ok 

19 

ok 

ok 

ok 

20 

ok 

ok 

ok 

21 

ok 

ok 

ok 

22 

delete 

delete 

ok 

23 

ok 

ok 

ok 

24 

delete 

delete 

delete 

25 

ok 

ok 

ok 

26 

delete 

remove  U 

remove  U 

27 

ok 

ok 

ok 

28 

ok 

ok 

ok 

29 

ok 

ok 

ok 

30 

check  date 

check  date 

check  date 

31 

ok 

ok 

ok 

32 

ok 

check  date 

check  date 

33 

ok 

ok 

ok 

34 

ok 

ok 

ok 

35 

delete 

delete 

delete 

36 

ok 

ok 

ok 

37 

ok 

ok 

ok 

38 

ok 

ok 

ok 

39 

ok 

ok 

ok 

40 

ok 

check  date 

check  date 

41 

ok 

ok 

ok 

42 

ok 

ok 

ok 

43 

ok 

ok 

ok 

44 

ok 

ok 

ok 

45 

ok 

ok 

ok 

46 

delete 

delete 

delete 

47 

delete 

delete 

delete 

48 

delete 

delete 

delete 

125 


Random  Sample  3  Decisions  (contJ 

Item 

Exoert  Decision 

Verified  Decision 

System  Decision 

•49 

p  report 

p  report 

p  report 

50 

delete 

delete 

delete 

126 


Random  Sample  4  Decisions 


Item 

Exoert  Decision 

Verified  Decision 

System  Decision 

1 

ok 

ok 

ok 

2 

ok 

ok 

ok 

3 

ok 

ok 

ok 

4 

ok 

ok 

ok 

5 

ok 

ok 

ok 

6 

ok 

ok 

ok 

1 

ok 

ok 

ok 

8 

ok 

ok 

ok 

9 

check  date 

check  date 

check  date 

10 

ok 

ok 

ok 

11 

ok 

ok 

ok 

12 

delete 

delete 

delete 

13 

check  date 

check  date 

check  date 

14 

ok 

ok 

ok 

15 

ok 

ok 

ok 

16 

ok 

ok 

ok 

17 

ok 

ok 

ok 

18 

delete 

delete 

delete 

19 

ok 

ok 

ok 

20 

ok 

ok 

ok 

21 

delete 

ok 

ok 

22 

ok 

ok 

ok 

23 

ok 

ok 

ok 

24 

ok 

ok 

ok 

25 

delete 

ok 

ok 

26 

ok 

ok 

ok 

27 

ok 

ok 

ok 

28 

check  date 

check  date 

check  date 

29 

ok 

ok 

ok 

30 

ok 

ok 

ok 

31 

ok 

ok 

ok 

32 

ok 

ok 

ok 

33 

delete 

delete 

delete 

34 

delete 

delete 

delete 

35 

delete 

delete 

delete 

36 

ok 

ok 

ok 

37 

ok 

ok 

ok 

38 

ok 

ok 

ok 

39 

ok 

remove  U 

remove  U 

40 

delete 

remove  U 

remove  U 

41 

ok 

ok 

ok 

42 

delete 

remove  U 

remove  U 

43 

delete 

delete 

delete 

44 

ok 

ok 

ok 

45 

ok 

ok 

ok 

46 

delete 

delete 

delete 

47 

delete 

delete 

delete 

48 

ok 

ok 

ok 

127 


Random  Sample  4  Decisions  (cont.) 


Exoert  Decision 

Verified  Decision 

System  Decision 

49 

p  report 

p  report 

p  report 

50 

delete 

delete 

delete 

128 


Random  Sample  5  Decisions 


Item 

Exoert  Decision 

Verified  Decision 

System  Decision 

1 

ok 

ok 

ok 

2 

check  date 

check  date 

check  date 

3 

delete 

delete 

delete 

4 

check  date 

check  date 

check  date 

5 

ok 

ok 

ok 

6 

ok 

ok 

ok 

7 

ok 

ok 

ok 

8 

check  date 

check  date 

check  date 

9 

ok 

ok 

ok 

10 

check  date 

check  date 

check  date 

11 

check  date 

check  date 

check  date 

12 

ok 

ok 

ok 

13 

ok 

ok 

ok 

H 

check  date 

check  date 

check  date 

15 

ok 

ok 

ok 

16 

check  date 

check  date 

check  date 

17 

check  date 

check  date 

check  date 

18 

check  date 

check  date 

check  date 

19 

ok 

ok 

ok 

20 

delete 

delete 

delete 

21 

ok 

ok 

ok 

22 

ok 

ok 

ok 

23 

ok 

ok 

ok 

24 

remove  U 

remove  U 

remove  U 

25 

remove  U 

remove  U 

ok 

26 

ok 

ok 

ok 

27 

check  date 

delete 

delete 

28 

delete 

delete 

delete 

29 

delete 

ok 

ok 

30 

ok 

ok 

ok 

31 

delete 

delete 

delete 

32 

delete 

delete 

delete 

33 

ok 

ok 

ok 

34 

check  date 

check  date 

check  date 

35 

ok 

ok 

ok 

36 

delete 

delete 

delete 

37 

ok 

ok 

ok 

38 

ok 

ok 

ok 

39 

check  date 

check  date 

check  date 

40 

ok 

ok 

ok 

41 

ok 

ok 

ok 

42 

ok 

ok 

ok 

43 

ok 

ok 

ok 

44 

ok 

ok 

ok 

45 

delete 

delete 

ok 

46 

remove  U 

remove  U 

remove  U 

47 

delete 

delete 

delete 

48 

delete 

delete 

delete 

129 

Random  Sample  5  Decisions  (cont.) 

Item  Expert  Decision  Verified  Decision  System  Decision 

49  delete  delete  delete 

50  p  report  p  report  p  report 


130 


Random  Sample  6  Decisions 


Item 

Exoeri  Decision 

Verified  Decision 

Svstem  Decision 

1 

ok 

ok 

ok 

2 

ok 

ok 

ok 

3 

check  date 

check  date 

check  date 

4 

check  date 

check  date 

check  date 

5 

ok 

ok 

ok 

6 

ok 

ok 

ok 

7 

check  date 

check  date 

check  date 

8 

check  date 

check  date 

check  date 

9 

ok 

ok 

ok 

10 

check  date 

delete 

delete 

11 

check  date 

check  date 

check  date 

12 

delete 

delete 

remove  U 

13 

ok 

ok 

ok 

H 

ok 

ok 

ok 

15 

ok 

ok 

ok 

16 

ok 

ok 

ok 

17 

ok 

ok 

ok 

18 

check  date 

excess 

excess 

19 

ok 

ok 

ok 

20 

check  date 

check  date 

check  date 

21 

check  date 

delete 

delete 

22 

check  date 

delete 

delete 

23 

ok 

ok 

ok 

24 

ok 

ok 

ok 

25 

delete 

ok 

ok 

26 

ok 

ok 

ok 

27 

ok 

ok 

ok 

28 

delete 

ok 

ok 

29 

ok 

ok 

ok 

30 

check  date 

check  date 

check  date 

31 

ok 

ok 

ok 

32 

delete 

delete 

delete 

33 

delete 

ok 

ok 

34 

ok 

ok 

ok 

35 

delete 

delete 

delete 

36 

check  date 

check  date 

check  date 

37 

delete 

ok 

ok 

38 

delete 

remove  U 

remove  U 

39 

ok 

ok 

ok 

40 

ok 

ok 

ok 

41 

ok 

ok 

ok 

42 

ok 

ok 

ok 

43 

ok 

ok 

ok 

44 

delete 

delete 

delete 

45 

delete 

ok 

ok 

46 

ok 

ok 

ok 

47 

ok 

ok 

ok 

48 

delete 

delete 

delete 

131 


Random  Sample  6  Decisions  (cont.) 


Item 

Exoert  Decision 

Verified  Decision 

System  Decision 

49 

delete 

delete 

delete 

50 

delete 

delete 

delete 

132 


Random  Sample  7  Decisions 


Ugm 

Exoert  Decision 

Verified  Decision 

System  Decision 

1 

delete 

delete 

delete 

2 

ok 

ok 

ok 

3 

check  date 

check  date 

check  date 

4 

ok 

ok 

ok 

5 

ok 

ok 

ok 

6 

ok 

ok 

ok 

7 

ok 

ok 

ok 

8 

check  date 

check  date 

check  date 

9 

check  date 

check  date 

check  date 

10 

ok 

ok 

ok 

11 

ok 

check  date 

check  date 

12 

ok 

check  date 

check  date 

13 

ok 

ok 

ok 

14 

ok 

ok 

ok 

15 

ok 

ok 

ok 

16 

ok 

ok 

ok 

17 

ok 

ok 

ok 

18 

ok 

ok 

ok 

19 

ok 

ok 

ok 

20 

ok 

ok 

ok 

21 

ok 

ok 

ok 

22 

ok 

ok 

ok 

23 

ok 

ok 

ok 

24 

delete 

delete 

delete 

25 

delete 

delete 

delete 

26 

delete 

ok 

ok 

27 

excess 

excess 

excess 

28 

ok 

remove  U 

remove  U 

29 

ok 

ok 

ok 

30 

ok 

ok 

ok 

31 

ok 

remove  U 

remove  U 

32 

ok 

ok 

ok 

33 

ok 

remove  U 

remove  U 

34 

ok 

ok 

ok 

35 

ok 

ok 

ok 

36 

delete 

remove  U 

remove  U 

37 

ok 

ok 

ok 

38 

delete 

delete 

delete 

39 

delete 

delete 

delete 

40 

delete 

delete 

delete 

41 

ok 

ok 

ok 

42 

ok 

ok 

ok 

43 

ok 

ok 

ok 

44 

delete 

delete 

delete 

45 

delete 

delete 

delete 

46 

delete 

delete 

delete 

47 

delete 

delete 

delete 

48 

delete 

delete 

delete 

133 

Random  Sample  7  Decisions  (cont.) 


Item  Expert  Decision  Verified  Decision 

49  delete  delete 

50  p  report  p  report 


System  Decision 

delete 
p  report 


134 


Random  Sample  $  Decisions 


Item 

Expert  Decision 

Verified  Decision 

Svstem  Decision 

1 

ok 

ok 

ok 

2 

ok 

ok 

ok 

3 

ok 

ok 

ok 

4 

check  date 

delete 

delete 

5 

ok 

ok 

ok 

6 

check  date 

check  date 

check  date 

7 

check  date 

check  date 

check  date 

8 

check  date 

check  date 

check  date 

9 

ok 

ok 

ok 

10 

ok 

ok 

ok 

11 

delete 

delete 

delete 

12 

delete 

delete 

delete 

13 

ok 

ok 

ok 

14 

check  date 

check  date 

check  date 

15 

ok 

ok 

ok 

16 

ok 

ok 

ok 

17 

check  date 

check  date 

check  date 

IS 

check  date 

check  date 

check  date 

19 

check  date 

check  date 

check  date 

20 

check  date 

check  date 

check  date 

21 

ok 

ok 

ok 

22 

ok. 

ok 

ok 

23 

ok 

ok 

ok 

24 

ok 

ok 

ok 

25 

ok 

delete 

delete 

26 

ok 

ok 

ok 

27 

ok 

ok 

ok 

28 

ok 

ok 

ok 

29 

ok 

ok 

ok 

30 

ok 

ok 

ok 

31 

ok 

delete 

delete 

32 

ok 

ok 

ok 

33 

delete 

delete 

delete 

34 

ok 

ok 

ok 

35 

ok 

ok 

ok 

36 

delete 

ok 

ok 

37 

ok 

ok 

ok 

38 

ok 

ok 

ok 

39 

delete 

delete 

delete 

40 

ok 

ok 

ok 

41 

delete 

ok 

ok 

42 

delete 

ok 

ok 

43 

ok 

ok 

ok 

44 

ok 

ok 

ok 

45 

delete 

delete 

delete 

46 

delete 

delete 

delete 

47 

delete 

delete 

delete 

48 

delete 

delete 

delete 

135 


Random  Sample  8  Decisions  (cont.) 


Item  Expert  Decision  Verified  Decision 

49  delete  delete 

50  p  report  p  report 


System  Decision 

delete 
p  report 
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Random  Sample  9  Decisions 


Item 

Expert  Decision 

Verified  Decision 

System  Decision 

1 

ok 

remove  U 

remove  U 

2 

ok 

ok 

ok 

3 

check  date 

check  date 

check  date 

4 

ok 

ok 

ok 

5 

ok 

ok 

ok 

6 

ok 

ok 

ok 

7 

ok 

ok 

ok 

8 

ok 

ok 

ok 

9 

ok 

ok 

ok 

10 

check  date 

check  date 

check  date 

11 

ok 

ok 

ok 

12 

ok 

ok 

ok 

13 

check  date 

remove  U 

remove  U 

14 

ok 

ok 

ok 

15 

ok 

ok 

ok 

16 

ok 

ok 

ok 

17 

ok 

ok 

ok 

18 

ok 

ok 

ok 

19 

ok 

ok 

ok 

20 

ok 

ok 

ok 

21 

ok 

ok 

ok 

22 

delete 

delete 

ok 

23 

ok 

ok 

ok 

24 

check  date 

remove  U 

remove  U 

25 

ok 

delete 

delete 

26 

ok 

remove  U 

remove  U 

27 

ok 

ok 

ok 

28 

ok 

remove  U 

remove  U 

29 

ok 

ok 

ok 

30 

ok 

ok 

ok 

31 

ok 

ok 

ok 

32 

ok 

ok 

ok 

33 

delete 

delete 

delete 

34 

ok 

ok 

ok 

35 

ok 

ok 

ok 

36 

ok 

ok 

ok 

37 

ok 

ok 

ok 

38 

ok 

remove  U 

remove  U 

39 

ok 

ok 

ok 

40 

ok 

ok 

ok 

41 

ok 

ok 

ok 

42 

delete 

delete 

delete 

43 

remove  U 

remove  U 

remove  U 

44 

remove  U 

remove  U 

remove  U 

45 

delete 

delete 

delete 

46 

delete 

delete 

delete 

47 

delete 

delete 

delete 

48 

delete 

delete 

delete 
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Item 


49 

50 


Random  Sample  9  Decisions  (cont.) 


Expert  Decision 

p  report 
delete 


Verified  Decision 

p  report 
delete 


System  Decision 

p  report 
delete 
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Random  Sample  10  Decisions 


Item 

Exoert  Decision 

Verified  Decision 

System  Decision 

1 

ok 

remove  U 

remove  U 

2 

ok 

ok 

ok 

3 

check  date 

check  date 

check  date 

4 

ok 

ok 

ok 

5 

ok 

ok 

ok 

6 

ok 

delete 

delete 

7 

ok 

ok 

ok 

8 

ok 

ok 

ok 

9 

check  date 

check  date 

check  date 

10 

ok 

ok 

ok 

11 

ok 

ok 

ok 

12 

delete 

delete 

delete 

13 

ok 

ok 

ok 

14 

ok 

ok 

ok 

15 

ok 

remove  U 

remove  U 

16 

ok 

ok 

ok 

17 

ok 

ok 

ok 

18 

ok 

ok 

ok 

19 

ok 

ok 

ok 

20 

delete 

delete 

delete 

21 

ok 

ok 

ok 

22 

ok 

ok 

ok 

23 

ok 

ok 

ok 

24 

ok 

ok 

ok 

25 

ok 

ok 

ok 

26 

ok 

ok 

ok 

27 

ok 

ok 

ok 

28 

check  date 

check  date 

check  date 

29 

ok 

ok 

ok 

30 

ok 

ok 

ok 

31 

ok 

ok 

ok 

32 

ok 

ok 

ok 

33 

ok 

ok 

ok 

34 

ok 

ok 

ok 

35 

delete 

delete 

delete 

36 

ok 

ok 

ok 

37 

ok 

ok 

ok 

38 

ok 

ok 

ok 

39 

ok 

ok 

ok 

40 

ok 

ok 

ok 

41 

ok 

ok 

ok 

42 

ok 

delete 

delete 

43 

ok 

ok 

ok 

44 

delete 

delete 

delete 

45 

ok 

ok 

ok 

46 

ok 

remove  U 

remove  U 

47 

ok 

ok 

ok 

48 

delete 

delete 

delete 
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Rariuom  Sample  1  Decisions  (cont.) 


Item 

Exoert  Decision 

Verified  Decision 

Sv'stem  Decision 

49 

p  report 

p  report 

p  report 

50 

delete 

delete 

delete 
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Random  Sample  11  Decisions 


Item 

Exoert  Decision 

Verified  Decision 

System  Decision 

1 

delete 

delete 

delete 

2 

check  date 

delete 

delete 

3 

ok 

ok 

ok 

4 

ok 

ok 

ok 

5 

ok 

ok 

ok 

6 

ok 

ok 

ok 

7 

ok 

ok 

ok 

8 

ok 

ok 

ok 

9 

check  date 

check  date 

check  date 

10 

ok 

ok 

ok 

11 

ok 

ok 

ok 

12 

ok 

delete 

delete 

13 

check  date 

check  date 

check  date 

1*4 

ok 

delete 

delete 

15 

ok 

ok 

ok 

16 

ok 

ok 

ok 

17 

ok 

ok 

ok 

18 

ok 

ok 

ok 

19 

ok 

ok 

ok 

20 

check  date 

check  date 

check  date 

21 

delete 

delete 

delete 

22 

delete 

delete 

delete 

23 

ok 

remove  U 

remove  U 

24 

ok 

remove  U 

remove  U 

25 

ok 

ok 

ok 

26 

ok 

ok 

ok 

27 

ok 

ok 

ok 

28 

ok 

delete 

delete 

29 

delete 

ok 

ok 

30 

delete 

ok 

ok 

31 

p  report 

p  report 

p  report 

32 

ok 

ok 

ok 

33 

ok 

remove  U 

remove  U 

34 

ok 

ok 

ok 

35 

delete 

delete 

delete 

36 

ok 

remove  U 

remove  U 

37 

delete 

delete 

delete 

38 

delete 

delete 

delete 

39 

delete 

delete 

delete 

40 

delete 

delete 

delete 

41 

delete 

delete 

delete 

42 

delete 

delete 

delete 

43 

delete 

delete 

delete 

44 

delete 

delete 

delete 

45 

delete 

delete 

delete 

46 

delete 

delete 

delete 

47 

delete 

delete 

delete 

48 

delete 

delete 

delete 
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Item 

49 

50 


Random  Sample  11  Decisions  (cont.) 


Expert  Decision 

delete 

delete 


Verified  Decision 

delete 

delete 


System  Decision 

delete 

delete 
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Random  Sample  12  Decisions 


Item 

Expert  Decision 

Verified  Decision 

System  Decision 

1 

delete 

delete 

delete 

2 

ok 

ok 

ok 

3 

ok 

ok 

ok 

4 

ok 

ok 

ok 

5 

ok 

ok 

ok 

6 

ok 

ok 

ok 

7 

ok 

ok 

ok 

8 

delete 

ok 

ok 

9 

ok 

ok 

ok 

10 

check  date 

delete 

delete 

11 

check  date 

delete 

delete 

12 

check  date 

check  date 

check  date 

13 

check  date 

excess 

excess 

14 

check  date 

delete 

delete 

15 

ok 

ok 

ok 

16 

delete 

ok 

ok 

17 

delete 

delete 

delete 

18 

ok 

ok 

ok 

19 

ok 

ok 

ok 

20 

delete 

delete 

delete 

21 

check  date 

check  date 

check  date 

22 

delete 

delete 

delete 

23 

ok 

ok 

ok 

24 

ok 

ok 

ok 

25 

ok 

ok 

ok 

26 

remove  U 

remove  U 

remove  U 

27 

delete 

ok 

ok 

28 

delete 

ok 

ok 

29 

p  report 

p  report 

p  report 

30 

ok 

ok 

ok 

31 

ok 

ok 

ok 

32 

check  date 

check  date 

check  date 

33 

ok 

ok 

ok 

34 

check  date 

check  date 

check  date 

35 

delete 

ok 

ok 

36 

delete 

delete 

delete 

37 

ok 

ok 

ok 

38 

ok 

ok 

remove  U 

39 

ok 

ok 

ok 

40 

p  report 

p  report 

p  report 

41 

delete 

delete 

delete 

42 

delete 

delete 

delete 

43 

delete 

delete 

delete 

44 

delete 

delete 

delete 

45 

delete 

delete 

delete 

46 

delete 

delete 

delete 

47 

p  reoport 

p  report 

p  report 

48 

p  report 

p  report 
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p  report 

Random  Sample  12  Decisions  (cont.) 


tism 

Exoert  Decision 

Verified  Decision 

System  Decision 

49 

delete 

delete 

delete 

50 

delete 

delete 

delete 
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Random  Sample  13  Decisions 


Item 

Exoert  Decision 

Verified  Decision 

Svstem  Decision 

1 

ok 

ok 

ok 

2 

ok 

ok 

ok 

3 

ok 

ok 

ok 

4 

ok 

ok 

ok 

5 

ok 

ok 

ok 

6 

ok 

ok 

ok 

7 

delete 

delete 

delete 

8 

ok 

ok 

ok 

9 

ok 

ok 

ok 

10 

ok 

ok 

ok 

11 

ok 

ok 

ok 

12 

check  date 

check  date 

check  date 

13 

ok 

ok 

ok 

14 

ok 

ok 

ok 

15 

ok 

check  date 

check  date 

16 

remove  U 

remove  U 

remove  U 

17 

ok 

ok 

ok 

18 

ok 

ok 

ok 

19 

ok 

ok 

ok 

20 

ok 

ok 

ok 

21 

ok 

ok 

ok 

22 

ok 

ok 

ok 

23 

delete 

delete 

delete 

24 

ok 

ok 

ok 

25 

ok 

remove  U 

remove  U 

26 

delete 

delete 

delete 

27 

ok 

ok 

ok 

28 

delete 

ok 

ok 

29 

ok 

ok 

ok 

30 

ok 

ok 

ok 

31 

ok 

ok 

ok 

32 

reomove  U 

remove  U 

remove  U 

33 

ok 

ok 

ok 

34 

delete 

delete 

delete 

35 

ok 

ok 

ok 

36 

delete 

delete 

delete 

37 

delete 

delete 

delete 

38 

p  report 

p  report 

p  report 

39 

delete 

delete 

delete 

40 

delete 

delete 

delete 

41 

delete 

delete 

delete 

42 

delete 

delete 

delete 

43 

delete 

delete 

delete 

44 

delete 

delete 

delete 

45 

delete 

delete 

delete 

46 

delete 

delete 

delete 

47 

delete 

delete 

delete 

48 

delete 

delete 

delete 
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Random  Sample  13  Decisions  (cont.) 


Item  Expert  Decision  Verified  Decision  System  Decision 

49  delete  delete  delete 

50  delete  delete  delete 


14b 


Random  Sample  14  Decisions 


Item 

Expert  Decision 

Verified  Decision 

Svstem  Decision 

1 

ok 

ok 

ok 

2 

ok 

ok 

ok 

3 

ok 

ok 

ok 

4 

delete 

delete 

delete 

5 

ok 

ok 

ok 

6 

ok 

ok 

ok 

7 

delete 

delete 

delete 

8 

check  date 

check  date 

check  date 

9 

ok 

ok 

ok 

10 

ok 

ok 

ok 

11 

check  date 

check  date 

check  date 

12 

ok 

ok 

ok 

13 

ok 

ok 

ok 

14 

ok 

ok 

ok 

15 

check  date 

check  date 

check  date 

16 

ok 

ok 

ok 

17 

ok 

ok 

ok 

IS 

ok 

ok 

ok 

19 

ok 

ok 

ok 

20 

ok 

ok 

ok 

21 

ok 

ok 

ok 

22 

ok 

ok 

ok 

23 

delete 

delete 

delete 

24 

ok 

check  date 

check  date 

25 

ok 

ok 

ok 

26 

ok 

ok 

ok 

27 

remove  U 

remove  U 

ok 

28 

delete 

delete 

delete 

29 

check  date 

check  date 

check  date 

30 

delete 

ok 

ok 

31 

ok 

ok 

ok 

32 

ok 

ok 

ok 

33 

delete 

ok 

ok 

34 

check  date 

check  date 

check  date 

35 

ok 

ok 

ok 

36 

ok 

ok 

ok 

37 

ok 

ok 

ok 

38 

delete 

delete 

delete 

39 

ok 

ok 

ok 

40 

ok 

ok 

ok 

41 

check  date 

check  date 

check  date 

42 

delete 

delete 

delete 

43 

ok 

ok 

ok 

44 

ok 

remove  U 

remove  U 

45 

delete 

delete 

delete 

46 

ok 

delete 

delete 

47 

ok 

ok 

ok 

48 

ok 

ok 

ok 
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Random  Sample  14  Decisions  (cont.) 


Item  Expert  Decision  Verified  Decis; 

49  delete  delete 

50  p  report  p  report 


on  System  Decision 

delete 
p  report 


Random  Sample  15  Decisions 


Item 

Exoert  Decision 

Verified  Decision 

Svstem  Decision 

1 

check  date 

check  date 

check  date 

2 

ok 

ok 

ok 

3 

ok 

ok 

ok 

ok 

ok 

ok 

5 

ok 

ok 

ok 

6 

ok 

ok 

ok 

-r 

ok 

ok 

ok 

8 

check  date 

check  date 

check  date 

9 

ok 

ok 

ok 

10 

check  date 

delete 

delete 

11 

ok 

remove  U 

remove  U 

12 

check  date 

check  date 

check  date 

13 

ok 

ok 

ok 

14 

check  date 

delete 

delete 

15 

ok 

ok 

ok 

16 

delete 

delete 

delete 

17 

ok 

remove  U 

remove  U 

18 

ok 

ok 

ok 

19 

ok 

ok 

ok 

20 

ok 

ok 

ok 

21 

ok 

ok 

ok 

22 

ok 

ok 

ok 

23 

ok 

ok 

ok 

24 

delete 

ok 

ok 

25 

ok 

delete 

delete 

26 

delete 

ok 

ok 

27 

ok 

ok 

ok 

28 

check  date 

check  date 

check  date 

29 

ok 

ok 

ok 

30 

ok 

ok 

ok 

31 

ok 

ok 

ok 

32 

ok 

ok 

ok 

33 

check  date 

check  date 

check  date 

34 

ok 

ok 

ok 

35 

ok 

ok 

ok 

36 

ok 

ok 

ok 

37 

ok 

ok 

ok 

38 

delete 

delete 

delete 

39 

ok 

ok 

ok 

40 

ok 

ok 

ok 

41 

ok 

ok 

ok 

42 

ok 

ok 

ok 

43 

ok 

ok 

ok 

44 

ok 

ok 

ok 

45 

ok 

ok 

ok 

46 

ok 

ok 

ok 

47 

ok 

ok 

ok 

48 

ok 

ok 

ok 

H9 


Random  Sample  15  Decisions  (cont.) 


Item 

Exoert  Decision 

Verified  Decision 

Svstem  Decision 

49 

delete 

delete 

delete 

50 

delete 

delete 

delete 
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Appendix  F:  YE  Expert  Listing 


ACTIONS 

COLOR  =  15 

WOPEN  1.3.5.17.70.3 
ACTIVE  1 


DISPLAY 

DISPLAY" 

DISPLAY 

DISPLAY 

DISPLAY 

DISPLAY- 

DISPLAY 

DISPLAY 

DISPLAY 

DISPLAY 

DISPLAY 

DISPLAY 

DISPLAY 

DISPLAY 

DISPLAY 

CLS 


Welcome  to  the  Monthly  Stock  Status  Manager  Tutorial 
VERSION  1.0" 

Developed  for ' 

2950  ABW  Hospital  Medical  Logistics  Branch" 
by 

Thomas  G.  Hibson 

Air  Force  Institute  for  Technology  (AFIT)" 

23  July  1991“ 


DISPLAY  This  tutorial  goes  along  with  the  Monthly  Stock  Status  Manager 
DISPLAY  "program  written  in  dBase.  This  tutorial  will  ask  you  questions 
DISPLAY  about  an  inventory  item  and  recommend  an  action  based  on  the 
DISPLAY  information  provided  by  you. 

DISPLAY 
DISPLAY 
DISPLAY 
DISPLAY  " 

COLOR  =  1 
DISPLAY 


When  you  are  ready  to  start  this  tutorial,  press  any  key... 
CLS 

WCLOSE  1 
COLOR  =  8 
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ans  =  yes 


CLS 

WHILETRUE  ans  =  yes 

THEN  DISPLAY  First  1  need  to  obtain  some  information  which  1  need  and 
do  not  have. 

FIND  nomen 
FIND  mnth 
FIND  begin_dt 
FIND  curr_date 
FIND  econ_lvl 
FIND  due_out 
FIND  cntrl_lvl 
FIND  past_deman 
five  =  5 
eleven  =  11 
FIND  ddr 
CLS 

DISPLAY  The  following  questions  will  determine  what  action  to  be 
taken. 

FIND  action 
CLS 

DISPLAY  Management  action  for  (nomen)  is  (^action). 

Press  any  key  to  continue...-’ 

CLS 

RESET  ALL 
FIND  more_data 
END 


display  Thank  you  for  letting  me  help  you."  ; 


RUNTIME; 

EXECUTE. 

BKCOLOR  =  1; 

ENDOFF: 

RULE  more_data  Iconverts  user  answer  to  data  structure  used  in  rules 
If  ans  *  yes 

THEN  more_data  =  true 
ELSE  more_data  =  UNKNOWN; 

RULE  dtd  ’converts  user  answer  to  data  structure  used  in  rules 
IF  dtd  =  yes 
THEN  dtd,cd  =  1 
ELSE  dtd_cd  =  0; 

RULE  consumpt  Iconverts  user  answer  to  data  structure  used  in  rules 


152 


IF  consumpt  =  yes 
THEN  consump  =  high 
ELSE  consump  =  low: 

RULE  man_cd  Iconverts  user  answer  into  data  structure  used  in  rules 
IF  man_cd  =  yes 
THEN  u  =  u 
ELSE  u  =  0: 

RULE  enter_date  !is  item  less  than  six  months  in  system 
IF  five  >  =  (curr_date  -  begin_dt) 

THEN  item_date  =  new  CNF  90  litem  is  less  than  six  months  in  system 
ELSE  item_date  =  old  CNF  95  litem  in  system  for  more  than  six  months 
BECAUSE  Age  of  item  record  is  important  to  some  decisions': 

RULE  pipeline_time  Ipipeline  time  for  item 

IF  avg_plt  <  =  31  131  days  chosen  as  breakpoint  for  long  or  short 

THEN  pipe  =  short  litem  has  short  pipeline 

ELSE  pipe  =  long  litem  has  long  pipeline 

BECAUSE  pipeline  time  can  determine  if  an  item  will  be  stocked' ; 

RULE  year  Idetermine  if  item  is  less  than  one  year  old 
IF  iiem_date  =  old  lis  item  more  than  six  months  old 

AND  eleven  >  (curr_date  -  begin_dt)  lis  item  less  than  1  year  old 
THEN  year  =  yes  litem  is  less  than  one  year  old 
ELSE  year  -  no:  litem  is  more  than  one  year  old 

RULE  delete  Idelete  items  with  no  demands  for  6  months 
IF  pres_deman  =  0  lis  item  had  no  demands  in  past  6  months 
AND  due_in  -  0  land  there  is  no  one  who  wants  this  item 
AND  due_out  =  0 
THEN  action  =  delete  CNF  95 

BECAUSE  If  (nomen)  has  not  been  used  in  past  six  months  and  there  are  no 
due  ins 

or  due  outs,  the  item  should  be  deleted. ": 

RULE  delet_one_hit  1  delete  items  which  have  one  hit  six  months  ago 
IF  monthb  >  0 
AND  month  1  =  0 
AND  monthZ  =  0 
AND  month3  =  0 
AND  months  =  0 
AND  months  =  0 
AND  due_in  =  0 
AND  due_out  =  0 
AND  item_date  =  new 
THEN  action  =  delete_one_hit  CNF  92 

BECAUSE  If  (nomen)  was  used  once  since  it  was  entered  into  the  system 
and 

if  that  was  six  months  ago.  it  should  be  deleted.  : 

RULE  delete_low_  use  Idelete  items  with  low  use  and  short  pipeline  time 
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!is  pipeline  short 


IF  pipe  =  short 
AND  due_out  =  0 
AND  due_in  =  0 
AND  item_date  =  old 
AND  consump  =  low  !is  consumption  low 
THEN  action  =  delete_low_use  CNF  85 

BECAUSE  "Management  does  not  want  to  stock  items  which  have  a  low 
consumption. 

less  than  .5  per  month,  if  the  item  has  a  short  pipeline  time.  '; 

RULE  delete_one_time_buys 
IF  one_time  =  yes 
AND  oper  =  0 
AND  due_in  =  0 
AND  due_out  =  0 
THEN  action  =  delete 

BECAUSE  items  designated  as  one  time  buyswith  nothing  on  hand  or  due  in 
or 

due  out  should  be  deleted" : 

RULE  p_report 
IF  one_time  =  yes 
AND  due_in  <  0 
AND  due_out  <>  0 
THEN  action  =  p_report 

BECAUSE  items  designated  as  one  time  buys  should  be  deleted.  ; 

RULE  excess 

IF  econ_ret  >  (.5  ’  econ_lvl) 

THEN  action  =  excess  CNF  91 

BECAUSE  Management  has  determined  to  exess  items  when  economic 
retention  quantity 

exceeds  half  of  the  economic  retention  level.  ': 

RULE  establish_level  !D/I  exceed  D/O  with  no  level  established 
IF  due_in  >  (due_out)  Ido  D/I  exceed  D/O 
AND  cntrl_lvl  =  0  Idoes  item  have  established  level 
AND  contract  =  no  litem  is  not  contract  specific 
THEN  action  =  establish_level  CNF  93 

cntrl_lvl  =  (ddr*60/ 1000*avg_plt*ddr/1000)  Isuggested  level 
BECAUSE  For  some  reason  due  in  quantity  exceeds  due  out  quantity  and 
there 

is  no  operating  level  set.  Perhaps  unit  pack  exceeds  the  amount  due  out.  : 

RULE  remove_u  IThree  good  demands  u  should  be  removed 
IF  u  =  u  lis  item  management  coded 

AND  item_date  =  new  lis  item  less  than  six  months  old 
AND  three_dema  =  yes  Idoes  item  have  3  demands  in  last  6  months 
THEN  action  =  remove_u  CNF  98 

BECAUSE  Items  being  used  consistently  should  be  managed  by  the 
computer. 

Checking  to  see  if  the  item  is  new,  management  coded,  and  there  have  been 
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three 

demands  in  the  last  six  months.  : 

RULE  remove_u_age  litem  is  over  6  months  old  and  less  than  1  year 
IF  item_date  =  old  ilet  computer  manage,  is  item  been  in  system  6  months 
AND  year  =  yes  litem  in  system  less  than  a  year 
AND  u  =  u  litem  is  being  managed 
THEN  action  =  remove_u_age  CNF  92 

BECAUSE  "Items  that  have  been  in  the  system  for  more  than  six  months  and 
less 

than  a  year  should  be  managed  by  the  computer.  Cheeking  to  see  if  the  item 
is 

less  than  a  year  in  the  system  and  management  coded. 

RULE  another_user  Isomeone  is  using  item  which  was  to  be  deleted 
IF  u  =  u  lis  item  being  managed 

AND  demand  =  consistent  lis  present  demand  consistent 

AND  item_date  =  old  Idoes  item  have  old  history  begin  date 

AND  pres_deman  <  (past_deman)  lis  present  demand  less  than  past 
demand 

THEN  action  =  remove_u_there_is_user  CNF  80 

BECAUSE  "Primary  user  may  have  asked  for  deletion  of  (nomen).  Checking 
to  see  if 

(nomen)  is  management  coded,  present  demand  is  consistent,  (nomen)  has 
been  in  the 

system  for  more  than  six  months,  and  the  present  demand  is  less  than  the 
past 

demand.  If  these  conditions  are  met  I  recommend  removal  of  the 
management  code.  ; 

RULE  ok  litem  is  being  used  at  less  than  requested  level 
IF  dtd_cd  '>  0  lis  item  date  coded 

AND  oper  >  =  (cntrl_lvl)  litem  is  not  being  used  as  fast  as  thought 
AND  cntrt_lvl  >  0 

THEN  action  =  check_date_OK  CNF  %  (ensure  item  won  t  expire  on  shelf 
BECAUSE  "(Nomen)  ispossibiy  being  used  slowly  and  is  dated.  If  these 
conditions 

are  met,  check  the  expiration  date  to  ensure  it  won  t  expire  on  the  shelf.  : 

RULE  aok 
IF  due_in  <>  0 
OR  prf‘s_deman  >  0 
THEN  action  =  ok  CNF  95 

BECAUSE  Item  is  being  used.  Leave  it  in  the  system.  : 

ask  infil:  What  is  the  filename  to  be  analyzed? 

(pathTilename)  note:  do  not  use  dbf  extension  : 

ask  ans:  Would  you  like  to  run  some  of  your  data?  ; 

CHOICES  ans:  YES.  NO: 

ask  nomen:  What  is  the  nomenclature  of  your  item?' : 
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ASK  past_deman:  How  many  (nomen)  were  ordered  six  months  to  a  year 
ago?"; 

ASK  pres_deman:  How  many  (nomen)  were  ordered  in  the  past  six 
months?": 

ASK  one_time:  Does  the  stock  number  contain  the  any  of  the  following 
strings?  LFB  IF  or  P  "; 

CHOICES  one_time;yes,  no; 

ASK  contract;  Does  the  stock  number  contain  the  string  CT?": 

CHOICES  contract:yes,  no; 

ASK  month  1:  "What  was  the  demand  for  the  month  prior  to  as  of  report 
month?(  month  1)"'; 

ASK  month2:  "What  was  the  demand  for  the  month  prior  to  month  1?"': 

ASK  month3:  "What  was  the  demand  for  the  month  prior  to  month  2?"; 

ASK  month4:  "  What  was  the  demand  for  the  month  prior  to  month  3?": 

ASK  monthS:  What  was  the  demand  for  the  month  prior  to  month  4?"  ; 

ASK  monlhb;  "  What  was  the  demand  six  months  ago?  "; 


ASK  begin_dt:  What  is  the  history  begin  date  for  (nomen)?' ; 

ASK  curr_date:  "What  is  the  as  of  date  for  the  report?"; 

ASK  due_out;  How  many  (nomen)s  are  due  out?"; 

ASK  due_in;  How  many  of  (nomenis  are  due  in?" ; 

ASK  ddr:  What  is  the  daily  demand  rate?": 

ASK  econ_lvl;  What  is  the  economic  retention  level  for  (nomen)?  ; 

ASK  econ_ret:  "^How  many  are  in  economic  retention?" : 

ASK  man_cd:  Is  (nomen)  management  coded?" ; 

Choices  man_cd:  yes.  no; 

ASK  cntrl_lvl:  What  is  the  suggested  inventory  level  for  (nomen)?  '; 

ASK  demand:  Has  the  demand  for  (nomen)  been  consistent  the  past  6 
months?  ; 

CHOICES  demand  consistent,  inconsistent; 

ASK  three_dema;  Have  there  bee  three  demands  placed  on  (nomen)  in  the 
past  six  months?  ; 

CHOICES  three.dema;  YES.  NO; 

ASK  consumpt:  Has  the  consumption  of  (nomen)  been  greater  than  .5  per 
month?"; 

Choices  consumpt;  yes.  no; 

ASK  dtd:  Is  (nomen)  date  coded?  : 

CHOICES  dtd:  yes.  no; 

ASK  oper:  "How  many  items  are  in  the  operating  stocks?"; 

ASK  avg^plt;  What  is  the  average  length  of  the  pipeline?  . 
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Appendix  G:  dBase  Listing  of  Expert  System 


Main  Program  Module 

SET  TALK  OFF 
SET  ECHO  OFF 

*  print  startup  screen 
ins  »  n " 

CLEAR 

@  5.36  SAY  WELCOME" 

@  6,37  SAY  "To  The" 

@  8.22  SAY  "MONTHLY  STOCK  STATUS  REPORT  PROGRAM 
10.34  SAY  "Version  1.0" 

12.31  SAY  "Developed  For  The" 

@  13.19  SAY  2950  ABW  Hospital  Medical  Logistics  Branch" 

@  15.39  SAY  "By" 

@  16.29  SAY  "CAPT  Thomas  G.  Hibson" 

@  17.20  SAY  "Air  Force  Institute  of  Technology  (AFIT)" 

@1  19.34  SAY  "11  June  1991" 

24.1  SAY  Do  you  wish  instructions  (Y/N):" 

@  24.33  GET  ins 
READ 

*  see  if  operator  wants  instructions 
IF  ins  »  "y  OR.  ins  =  Y" 

CLEAR 

<s»  5.15  SAY  This  program  determines  what  management  actions  to 
initiate  on" 

I?  6.15  SAY  medical  inventory  items.  The  input  file  should  be  an 
un  parsed 

^  7,15  SAY  ASCII  file  of  the  inventory  leveling  data.  The  program 
creates 

»  8.15  SAY  an  output  file  (dBase  format)  into  which  the  input  data  is  to 
be" 

9.15  SAY  parsed.  The  program  then  makes  a  decision  on  each 
individual 

9  10.15  SAY  item  and  then  prints  action  specific  reports.  The  output 
file 

11.15  SAY  contains  all  of  the  original  input  data,  all  data  generated 

(3>  12.15  SAY  during  the  decision  process,  and  the  recommended  decision. 
The 

@1  13.15  SAY  program  requires  free  memory  of  approximately  three  (3) 
times 

14.15  SAY  greater  than  the  amount  of  memory  used  by  the  input  file. 

15.15  SAY  Just  input  file  names  when  prompted  and  leave  the  printer 
on 

@  16.15  SAY  to  print  the  reports. 

(a  24,1  SAY  Do  you  wish  to  run  the  program  (Y/N):" 

24,39  GET  ins 
READ 

*  see  if  operator  wishes  to  quit 
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IF  ins  =  “n  "  .OR.  ins  =  N  " 

QUIT 

ENDIF 

ENDIF 

^Create  new  file  to  parse  data  into  using  pars.tmp  as  a  template 
USE  PARS.TMP 

COPY  STRUCTURE  TO  PARSE.DBF 
*Get  input  output  files  from  user 
infile= 
outfile=" 

CLEAR 

@>10.10  SAY  What  is  the  name  of  the  input  file?  (path:filename.ext) 

@>11,10  GET  infile 
READ 

DO  WHILE  .NOT.  (FILE(TRIM(infile))  .OR.  FILE(TRIM(infile)*''.TXT" )) 
CLEAR 
infile  = 

@>10.10  SAY  File  does  not  exist.  What  is  name  of  input  file? 
(path:filename:ext) 

@>11,10  GET  infile 
READ 
ENDDO 
CLEAR 

@>12.10  SAY  What  file  should  1  write  the  results  to?  (path:filename.ext)" 

@>13.10  GET  outfile 

READ 

overwrite  =  n 

DO  WHILE  (FILE(TRIM(outfiIe))  .OR.  FILE(TRIM(outfile)* "  dbr  ) )  AND. 
(overwrite  =  n  OR.  overwrite  =  "N") 

CLEAR 

@>9,10  SAY  File  already  exists.  Should  I  overwrite  the  file?" 

@>10,10  GET  overwrite 
READ 

IF  overwrite  =  n  .OR  overwrite  =  "N  " 
outfile  = 

CLEAR 

@>10.10  SAY  What  is  name  of  output  file?  (path:filename;ext) 

@>11,10  GET  outfile 
READ 
ENDIF 
ENDDO 

’Create  new  file  to  do  decisions  on  using  dat.tmp  as  a  template 
CLEAR 

@>10,10  SAY  PLEASE  DO  NOT  DISTURB. 

@>11.11  SAY  I  AM  PARSING  DATA  ' 

SELECT  B 
USE  DAT.TMP 

COPY  STRUCTURE  TO  ^.outfile 
CLOSE  DATABASES 
SELECT  A 

'Parse  new  data  from  ASCII  text  file 
USE  PARSE.DBF 
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APPEND  FROM  ficinfile  TYPE  SDF 

DELETE  RECORD  1 

PACK 

*Copy  parsed  data  to  decision  file 
CLOSE  DATABASES 
USE  Scoutfile 

APPEND  FROM  PARSE.DBF 

*  delete  unneeded  parse  file 
DELETE  FILE  PARSE.DBF 

@11.11  SAY  T  AM  NOW  DOING  DATA  PREP. 

*start  of  data  manipulation 

*  leveling  data  has  price  times  100 
REPLACE  ALL  price  WITH  price/100 

*  leveling  data  has  ddr  times  1000 
REPLACE  ALL  ddr  WITH  ddr/1000 

’create  report  as  of  date  in  same  format  as  history  begin  date 
REPLACE  All  curr_date  WITH  year_rpt’100+mnth_rpt 
’correct  as  of  report  dates  for  turn  of  century 
GOTO  2 

IF  curr_date<100 

REPLACE  ALL  curr_date  WITH  curr_date+ 10000 
ENDIF 

*AFM  167-230  defines  economic  retention  level  as  720  times  ddr 
REPLACE  ALL  econjvl  WITH  720*ddr 

’calculate  economic  retention  quantity  (operating  quantity  -  control  level) 
REPLACE  ALL  econ_ret  WITH  oper-cntrl  Ivl 
@11.11  SAY  T  AM  NOW  MAKING  DECISIONS.' 

’set  record  pointer  to  zero 

SET  STATUS  ON 

i=0 

GOTO  TOP 

’determine  month  of  report  and  do  the  following: 

*  find  how  many  items  were  ordered  the  past  six  months 

*  find  how  many  items  were  ordered  previous  six  months 

*  Go  through  file  incrementally  to  determine  the  following; 

’  determine  if  consumption  is  low  or  high 

’  store  needed  variables  in  memory 

’  increment  record  pointer 

’  determine  management  action 

DO  CASE 
CASE  mnth_rpt  =  2 

REPLACE  ALL  pres_deman  WITH  aug*sep*oct*nov*dec*ian 
REPLACE  ALL  past_deman  WITH  feb*mar*apr*may*jun  +  jut 
GOTO  TOP 

DO  WHILE  NOT.  EOFO 
IF  pres_deman/6<.3 

REPLACE  consump  WITH  low 
ELSE 

REPLACE  consump  WITH  high 
ENDIF 

STORE  aug  TO  ml 
STORE  sep  TO  m2 
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STORE  oct  TO  ni3 
STORE  nov  TO  m4 
STORE  dec  TO  m5 
STORE  jan  TO  m6 
STORE  cntrl_lvl  TO  Ivl 
i=i*  1 

DO  MANACT  WITH  ml.m2,m3.m4.m5.m6.1vl,i.outfile 
SKIP 
ENDDO 

CASE  mnth_rpt  =  3 

REPLACE  ALL  pres_deman  WITH  sep+oct*nov+dec*jan*feb 
REPLACE  ALL  past_deman  WITH  mar*apr*fnay*jun*jul+aug 
GOTO  TOP 

DO  WHILE  NOT.  EOF( ) 

IF  pres_deman/6'.3 

REPLACE  consump  WITH  "low" 

ELSE 

REPLACE  consump  WITH  "high 
ENDIF 

STORE  sep  TO  ml 
STORE  oct  TO  m2 
STORE  nov  TO  m3 
STORE  dec  TO  m4 
STORE  jan  TO  mS 
STORE  feb  TO  mb 
STORE  cntrl_lvl  TO  Ivl 
i=i*l 

DO  MANACT  WITH  ml.  m2,  m3,  m*!.  mS,  mb.  Ivl,  i.  outfile 
SKIP 
ENDDO 

CASE  mnth_rpt  =  4 

REPLACE  ALL  pres_deman  WITH  oct*nov*dec*jan*feb»mar 
REPLACE  ALL  past_deman  WITH  apr*may*jun+jul*aug*sep 
GOTO  TOP 

DO  WHILE  .NOT.  EOFO 
IF  pres_deman/b<.3 

REPLACE  consump  WITH  "low" 

ELSE 

REPLACE  consump  WITH  "high" 

ENDIF 

STORE  oct  TO  ml 
STORE  nov  TO  m2 
STORE  dec  TO  m3 
STORE  jan  TO  m4 
STORE  feb  TO  m5 
STORE  mar  TO  mb 
STORE  cntrLlvl  TO  Ivl 
i=i*  1 

DO  MANACT  WITH  ml.  m2,  m3.  m4.  m5,  mb.  Ivl,  i,  outfile 
SKIP 
ENDDO 

CASE  mnth_rpt  =  5 
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REPLACE  ALL  pres_deman  WITH  nov+dec*jan  +  feb+mar*apr 
REPLACE  ALL  past_deman  WITH  may*iun*jul+aug+sep*oct 
GOTO  TOP 

DO  WHILE  .NOT.  EOFO 
IF  pres_deman/6<.3 

REPLACE  consump  WITH  low’ 

ELSE 

REPLACE  consump  WITH  high 
ENDIF 

STORE  nov  TO  ml 
STORE  dec  TO  m2 
STORE  jan  TO  m3 
STORE  feb  TO  m4 
STORE  mar  TO  m5 
STORE  apr  TO  m6 
STORE  cntrl_lvl  TO  Ivl 
i=i*  1 

DO  MANACT  WITH  ml.m2,m3.m4.m5,m6.lvl,i.outfile 
SKIP 
ENDDO 

CASE  mnth_rpt  =  6 

REPLACE  ALL  pres_deman  WITH  dec*jan*feb*mar*apr*may 
REPLACE  ALL  past_deman  WITH  jun*jul*aug+sep*oct<^nov 
GOTO  TOP 

DO  WHILE  NOT.  EOFO 
IF  pres_deman/6<.3 

REPLACE  consump  WITH  low' 

ELSE 

REPLACE  consump  WITH  high 
ENDIF 

STORE  dec  TO  ml 
STORE  jan  TO  m2 
STORE  feb  TO  m3 
STORE  mar  TO  m4 
STORE  apr  TO  m5 
STORE  may  TO  m6 
STORE  cntrl_lvl  TO  Ivl 
i=i*  1 

DO  MANACT  WITH  ml.m2.m3.m4.m5,m6.1vl.i,outfile 
SKIP 
ENDDO 

CASE  mnth_rpt  =  7 

REPLACE  ALL  pres_deman  WITH  jan*feb*mar*apr*may+jun 
REPLACE  ALL  past_deman  WITH  jul*aug*sep*oct+nov+dec 
GOTO  TOP 

DO  WHILE  .NOT.  EOFO 
IF  pres_deman/6  .3 

REPLACE  consump  WITH  low 
ELSE 

REPLACE  consump  WITH  high 
ENDIF 

STORE  jan  1 0  ml 
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STORE  feb  TO  m2 
STORE  mar  TO  m3 
STORE  apr  TO  m4 
STORE  may  TO  m5 
STORE  jun  TO  m6 
STORE  cntrijvl  TO  Ivl 
i=i*  1 

DO  MANACT  WITH  ml.m2.m3.m4,m5.m6.1vl.i.outfiIe 
SKIP 
ENDDO 

CASE  mnth_rpt  =  8 

REPLACE  ALL  pres_deman  WITH  feb*mar*apr*may*jun* jul 
REPLACE  ALL  past_deman  WITH  aug*sep*oct*nov*dec*jan 
GOTO  TOP 

DO  WHILE  .NOT.  EOF( ) 

IF  pres_deman/6<,3 

REPLACE  consump  WITH  Tow 
ELSE 

REPLACE  consump  WITH  "high" 

ENDIF 

STORE  feb  TO  ml 
STORE  mar  TO  m2 
STORE  apr  TO  m3 
STORE  may  TO  m4 
STORE  jun  TO  mS 
STORE  jut  TO  mb 
STORE  cntrLlvl  TO  Ivl 
i=i*  1 

DO  MANACT  WITH  ml,m2.m3.m4.m5.m6.1vl.i,outfile 
SKIP 
ENDDO 

CASE  mnth_rpt  =  9 

REPLACE  ALL  pres_deman  WITH  mar*apr*mayjun*jul*aug 
REPLACE  ALL  past_deman  WITH  sep*oct*nov*dec*jan*feb 
GOTO  TOP 

DO  WHILE  NOT.  EOFO 
IF  pres_deman/6<.3 

REPLACE  consump  WITH  low 
ELSE 

REPLACE  consump  WITH  high 
ENDIF 

STORE  mar  TO  ml 
STORE  apr  TO  m2 
STORE  may  TO  m3 
STORE  jun  TO  m4 
STORE  jul  TO  m5 
STORE  aug  TO  mb 
STORE  cntrl_lvl  TO  Ivl 
i  =  i*  1 

DO  MANACT  WITH  ml.m2.m3.m4.m5.m6,lvl.i,outfile 
SKIP 
ENDDO 
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CASE  mnth_rpt  =  10 

REPLACE  ALL  pres_deman  WITH  apr*may*jun*jul*aug*sep 
REPLACE  ALL  past_deman  WITH  oct+novdec+jan*feb*mar 
GOTO  TOP 

DO  WHILE  .NOT.  EOFO 
IF  pres_deman/6<.3 

REPLACE  consump  WITH  "low" 

ELSE 

REPLACE  consump  WITH  “high" 

ENDIF 

STORE  apr  TO  ml 
STORE  may  TO  m2 
STORE  jun  TO  m3 
STORE  jul  TO  m4 
STORE  aug  TO  m5 
STORE  sep  TO  m6 
STORE  cntrl_lvl  TO  Ivl 
i=i*  1 

DO  MANACT  WITH  ml.m2.m3.m‘4.m5.m6.1vl.i,outfile 
SKIP 
ENDDO 

CASE  mnth_rpi  =  11 

REPLACE  ALL  pres_deman  WITH  mayjun*jul*aug*sep+oct 
REPLACE  ALL  past_deman  WITH  nov*dec*jan*feb*mar*apr 
GOTO  TOP 

DO  WHILE  .NOT.  EOFO 
IF  pres_deman/6  .3 

REPLACE  consump  WITH  Tow' 

ELSE 

REPLACE  consump  WITH  high' 

ENDIF 

STORE  may  TO  ml 
STORE  jun  TO  m2 
STORE  jul  TO  m3 
STORE  aug  TO  m^ 

STORE  sep  TO  mS 
STORE  oct  TO  mb 
STORE  cntrl_lvl  TO  Ivl 
i=i+ 1 

DO  MANACT  WITH  ml,m2,m3.m4.m5.m6.1vl.i.outfile 
SKIP 
ENDDO 

CASE  mnth_rpt  =  12 

REPLACE  ALL  pres_deman  WITH  jun*jul*aug*sep*oct+nov 
REPLACE  ALL  past_deman  WITH  dec*jan»feb*mar*apr*may 
GOTO  TOP 

DO  WHILE  NOT.  EOFO 
IF  pres_deman/6<.3 

REPLACE  consump  WITH  low' 

ELSE 

REPLACE  consump  WITH  high 
ENDIF 
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STORE  jun  TO  ml 
STORE  jul  TO  m2 
STORE  aug  TO  m3 
STORE  sep  TO  m4 
STORE  ocl  TO  m5 
STORE  nov  TO  m6 
STORE  cntrl_lvl  TO  Ivl 
i=i*  1 

DO  MAN  ACT  WITH  ml.m2.m3.m4.m5.m6,lvl,i.outfile 
SKIP 
ENDDO 
OTHERWISE 

REPLACE  ALL  pres_deman  WITH  jul*aug*sep*oct*nov+dec 
REPLACE  ALL  past_deman  WITH  jan*feb*mar*apr*may*jun 
GOTO  TOP 

DO  WHILE  NOT.  EOFO 
IF  pres_deman/6<.3 

REPLACE  consump  WITH  low' 

ELSE 

REPLACE  consump  WITH  'high' 

ENDIF 

STORE  jul  TO  ml 
STORE  aug  TO  m2 
STORE  sep  TO  m3 
STORE  oct  TO  m4 
STORE  nov  TO  m5 
STORE  dec  TO  m6 
STORE  cntrLlvl  TO  Ivl 
i=i*  1 

DO  MANACT  WITH  ml.m2.m3,m4,m5.m6,lvl.i,outfile 
SKIP 
ENDDO 

ENDCASE 

•» 

*  adjust  all  econ  ret  less  than  0  to  0 
REPLACE  ALL  econ_ret  WITH  0  FOR  econ_ret<0 

*  adjust  oper  not  exceed  cntrl  Ivl 

REPLACE  ALL  oper  WITH  oper  -  econ_ret  -  excess 

*  print  reports 

^11. 11  SAY  I  AM  PRINTING  REPORTS. 

DO  REPORTS  WITH  outfile 

CLEAR 

*  exit  program 

is  11.10  SAY  I  have  finnished  printing  the  reports. 

(a  12.10  SAY  Thank  you  for  using  the  Monthly  Stock  Status  Report 

Program. 

* 

'End  of  Program 
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Manact  Module 


PARAMETERS  ml.m2.m3.m’4.m5.m6.1vi.i,outfile 
USE  fitoutfile 

GOTO  i 

•» 

•determine  if  item  is  old  or  new 

IF  year_rpt*  100-begin_dt>=88  .AND.  year_rpt* l00-begin_dt<=99 
IF  mnth_rpt*  12+((year_rpt-l )*  100)-begin_dt<6 
item_date  =  new' 

ELSE 

item_date  ='old'' 

ENDIF 

ELSE 

IF  curr_date-begin_dt  <  6 
item_date  =  new" 

ELSE 

item_date  =  old 
ENDIF 
ENDIF 

•determine  if  item  has  been  in  system  for  less  than  one  year 
IF  curr_date-begin_dt  <=  100 
year  =  yes 
ELSE 

year  =  no 
ENDIF 

•start  of  decision  process 

•» 

•Delete  all  items  not  used  in  the  past  six  months  with  no  due  ins 
IF  pres_deman  =  0  AND.  due_in  =  0  .AND.  due_out  =  0 
REPLACE  action  WITH  delete 

ELSE 

* 

•  Delete  all  items  with  one  hit  six  months  ago  and  no  due  ins 

IF  ml  =  pres_deman  AND.  due_in  =  0  AND  due_out  =  0  AND. 
item_date  =  "new 
REPLACE  action  WITH  delete" 

ELSE 

■» 

•  Delete  items  with  short  pipelines  and  low  consumption  and  in 

•  system  for  a  for  minimum  of  six  months 

IF  avg_plt  =  31  AND.  consump  ="low"  AND.  due_in  =  0  AND. 
due_out  =  0  AND.  item_date=  old 
REPLACE  action  WITH  delete 
ELSE 

• 

•  delete  items  with  p,  Ifb  or  if  in  stock  number 

IF  LEFTfnsn.I)  =  P  .OR.  AT(  LFB  .nsn )  >0  OR  ^ 
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RIGHT(RTRIM(nsn).2)  =  "IF 
IF  due_in  =  0  .AND.  due_out  =  0 
REPLACE  action  WITH  "delete" 

ELSE 

REPLACE  action  WITH  p  report" 

ENDIF 

ELSE 

should  item  be  put  in  excess  status 
IF  econ_ret  -  due_out  >  .5  *  econ_lvi 
REPLACE  action  WITH  "excess" 

ELSE 

Should  a  level  be  established 
IF  due_in>due_out  .AND.  cntrl_lvl  =  0  .AND. 

AT(  "CT  '.nsn)  =  0 

REPLACE  action  WITH  "establish  level 
IF  ddr=0 

REPLACE  cntrl_lvl  WITH  due_in-due_out 
ELSE 

REPLACE  cntrl  Ivl  WITH  ddr*60*31*ddr 
ENDIF 
ELSE 

Should  U  code  be  removed  for  three  good  demands 
DO  THREE  WITH  ml.  m2,  m3.  m4,  m5.  mb.  i.outfile 
IF  u=  U"  AND.  item_date=  new"  .AND.  three_dema="yes 
REPLACE  action  WITH  "remove  u  ' 

ELSE 

Should  u  be  removed  because  item  in  system  for 
longer  than  six  months 

IF  item_date= "old"  .AND.  year="yes  .AND.  u=  U 
REPLACE  action  WITH  remove  u 
ELSE 

Should  u  be  removed  because  there  is  another 
user 

NOTE:  demand  must  be  consistent  in  order  to 
remove  U 

DO  CONSIS  WITH  ml.  m2,  m3,  m*!,  m5.  mb.  Ivl,  i. 
outfile 

IF  u=  U  AND.  demand_con=  consistent  AND. 
item_date=  old  .AND. 
pres_deman  <  .75  *  past_deman 
REPLACE  action  WITH  remove  u 
ELSE 

item  being  used  less  than  requested  and  dated 
IF  dtd_cd<>0  AND.  oper  =cntrl_lvl  .AND. 
cntrl_lvl'0 

REPLACE  action  WITH  check  date 
ELSE 


Item  is  being  used 


IF  due_in<'0  .OR.  pres_deman>0  OR. 
due_out  <>  0 

REPLACE  action  WITH  ok 
ELSE 

*  action  is  unknown 

REPLACE  action  WITH  unknown 
ENDIF 
ENDIF 
ENDIF 
ENDIF 
ENDIF 
ENDIF 
ENDIF 
ENDIF 
ENDIF 
ENDIF 
ENDIF 
RETURN 
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Three  Module 


PARAMETERS  ml,  m2,  m3,  m4.  mS,  m6.  i.  outfile 
USE  Scoutfile 
GOTO  i 
IF  ml  '  0 
one=l 
ELSE 
one=0 
ENDIF 
IF  m2  >  0 
two=l 
ELSE 
two=0 
ENDIF 
IF  m3  >  0 
three=I 
ELSE 
three=0 
ENDIF 
IF  m4  0 
four=l 
ELSE 
four=0 
ENDIF 
IF  m5>0 
five=l 
ELSE 
five=0 
ENDIF 
IF  m6  0 
six=l 
ELSE 
six=0 
ENDIF 

IF  one*two*ihree*four‘five»six  ^=3 
REPLACE  three_dema  WITH  yes 
ELSE 

REPLACE  three_dema  WITH  no 
ENDIF 
RETURN 
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Consis  Module 


PARAMETERS  011,012.013.111*4,015,016.^1.1.001^10 
USE  itoutfile 
GOTO  i 

IF  oil  +  oi2=0  OR.  oi2*oi3=0  OR.  oi3*-oi4=0  .OR.  oi4+oi5=0  .OR.  oi5+oi6=0 
REPLACE  deoiand_con  WITH  "inconsistent" 

ELSE 

REPLACE  deniand_con  WITH  "consistent" 

ENDIF 

IF  nil>=lvl  OR.  ni2>=lvl  .OR.  ni3>=lvl  .OR.  ni4'=lvl  .OR.  ni5>=lvl  .OR.  ni6'=lvl 
REPLACE  deniand_con  WITH  "  inconsistent" 

ENDIF 

RETURN 
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Reports  Module 


PARAMETERS  outfile 
USE  6coutfile 
GOTO  TOP 
DO  CASE 

CASE  mnth_rpt  =  01 

SORT  ON  psm.nsn  FOR  ACTION  =  'delete'  TO  DREPORT 
USE  DREPORT 

REPORT  FORM  JANDEL.FRM  FOR  action  =  delete '  TO  PRINT 
CLOSE  DATABASES 
DELETE  FILE  DREPORT.DBF 
USE  ScOUTFILE 

REPORT  FORM  JANPRPT.FRM  FOR  action  =  "p  report"  TO  PRINT 
REPORT  FORM  JANRMVU.FRM  FOR  action  =  remove  u  TO  PRINT 
REPORT  FORM  JANCHKDT.FRM  FOR  action  =  check  date '  TO  PRINT 
REPORT  FORM  JANEX.FRM  FOR  action  =  "excess'  TO  PRINT 
REPORT  FORM  JANESTLV.FRM  FOR  action  =  "establish  level'  TO 
PRINT 

REPORT  FORM  JANUNK.FRM  FOR  action  =  unknown  TO  PRINT 
CASE  mnth  rpt  =  02 

SORT  ON  psm.nsn  FOR  ACTION  =  "delete '  TO  DREPORT 
USE  DREPORT 

REPORT  FORM  FEBDEL.FRM  FOR  action  =  "delete"  TO  PRINT 
CLOSE  DATABASES 
DELETE  FILE  DREPORT.DBF 
USE  icOUTFILE 

REPORT  FORM  FEBPRPT.FRM  FOR  action  =  p  report"  TO  PRINT 
REPORT  FORM  FEBRMVU.FRM  FOR  action  =  "remove  u  TO  PRINT 
REPORT  FORM  FEBCHKDT.FRM  FOR  action  =  check  date '  TO 
PRINT 

REPORT  FORM  FEBEX.FRM  FOR  action  =  excess"  TO  PRINT 
REPORT  FORM  FEBESTLV.FRM  FOR  action  =  "establish  level"  TO 
PRINT 

REPORT  FORM  FEBUNK.FRM  FOR  action  =  "  unknown  "  TO  PRINT 
CASE  mnth_rpt  =  03 

SORT  ON  psm.nsn  FOR  ACTION  =  "delete  TO  DREPORT 
USE  DREPORT 

REPORT  FORM  MARDEL.FRM  FOR  action  =  "delete  TO  PRINT 
CLOSE  DATABASES 
DELETE  FILE  DREPORT.DBF 
USE  ScOUTFILE 

REPORT  FORM  MARPRPT.FRM  FOR  action  =  "p  report  TO  PRINT 
REPORT  FORM  MARRMVU  FRM  FOR  action  =  "remove  u  "  TO  PRINT 
REPORT  FORM  MARCHKDT.FRM  FOR  action  =  "check  date  TO 
PRINT 

REPORT  FORM  MAREX.FRM  FOR  action  =  excess  TO  PRINT 
REPORT  FORM  MARESTLV.FRM  FOR  action  =  "establish  level  TO 
PRINT 

REPORT  FORM  MARUNK  FRM  FOR  action  =  unknown  TO  PRINT 
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CASE  mnth_rpt  =  04 

SORT  ON  psm.nsn  FOR  ACTION  =  delete  '  TO  DREPORT 
USE  DREPORT 

REPORT  FORM  APRDEL.FRM  FOR  action  =  "delete  TO  PRINT 
CLOSE  DATABASES 
DELETE  FILE  DREPORT.DBF 
USE  icOUTFILE 

REPORT  FORM  APRPRPT.FRM  FOR  action  =  p  report'  TO  PRINT 
REPORT  FORM  APRRMVU.FRM  FOR  action  =  "remove  u'  TO  PRINT 
REPORT  FORM  APRCHKDT.FRM  FOR  action  =  check  date '  TO 
PRINT 

REPORT  FORM  APREX.FRM  FOR  action  =  excess'  TO  PRINT 
REPORT  FORM  APRESTLV.FRM  FOR  action  =  establish  level  "  TO 
PRINT 

REPORT  FORM  APRUNK.FRM  FOR  action  =  'unknown  TO  PRINT 
CASE  mnth_rpt  =  05 

SORT  ON  psm.nsn  FOR  ACTION  =  "delete '  TO  DREPORT 
USE  DREPORT 

REPORT  FORM  MAYDEL.FRM  FOR  action  =  "delete"  TO  PRINT 
CLOSE  DATABASES 
DELETE  FILE  DREPORT.DBF 
USE  6tOUTFILE 

REPORT  FORM  MAYPRPT.FRM  FOR  action  =  "p  report"  TO  PRINT 
REPORT  FORM  MAYRMVU.FRM  FOR  action  =  remove  u  TO  PRINT 
REPORT  FORM  MAYCHKDT.FRM  FOR  action  =  "check  date  TO 
PRINT 

REPORT  FORM  MAYEX.FRM  FOR  action  =  excess'  TO  PRINT 
REPORT  FORM  MAYESTLV.FRM  FOR  action  =  establish  level"  TO 
PRINT 

REPORT  FORM  MAYUNK.FRM  FOR  action  =  unknown  TO  PRINT 
Case  mnth_rpt  =  06 

SORT  ON  psm.nsn  FOR  ACTION  =  "delete  "  TO  DREPORT 
USE  DREPORT 

REPORT  FORM  JUNDEL.FRM  FOR  action  =  "delete"  TO  PRINT 
CLOSE  DATABASES 
DELETE  FILE  DREPORT.DBF 
USE  &COUTFILE 

REPORT  FORM  JUNPRPT.FRM  FOR  action  =  p  report"  TO  PRINT 
REPORT  FORM  JUNRMVU.FRM  FOR  action  =  "remove  u"  TO  PRINT 
REPORT  FORM  JUNCHKDT.FRM  FOR  action  =  "check  date"  TO  PRINT 
REPORT  FORM  JUNEX.FRM  FOR  action  =  "excess  TO  PRINT 
REPORT  FORM  JUNESTLV.FRM  FOR  action  =  establish  level"  TO 
PRINT 

REPORT  FORM  JUNUNK.FRM  FOR  action  =  "unknown  TO  PRINT 
CASE  mnth_rpt  =  07 

SORT  ON  psm.nsn  FOR  ACTION  =  "delete  TO  DREPORT 
USE  DREPORT 

REPORT  FORM  JULDEL.FRM  FOR  action  =  delete"  TO  PRINT 
CLOSE  DATABASES 
DELETE  FILE  DREPORT.DBF 
USE  icOUTFILE 

REPORT  FORM  JULPRPT.FRM  FOR  action  =  "p  report  TO  PRINT 
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REPORT  FORM  JULRMVU.FRM  FOR  action  =  "remove  u"  TO  PRINT 
REPORT  FORM  JULCHKDT.FRM  FOR  action  =  "check  date"  TO  PRINT 
REPORT  FORM  JULEX.FRM  FOR  action  =  "excess  TO  PRINT 
REPORT  FORM  JULESTLV.FRM  FOR  action  =  establish  level"  TO 
PRINT 

REPORT  FORM  JULUNK.FRM  FOR  action  =  "unknown  TO  PRINT 
CASE  mnth_rpt  =  08 

SORT  ON  psm.nsn  FOR  ACTION  =  "delete"  TO  DREPORT 
USE  DREPORT 

REPORT  FORM  AUGDEL.FRM  FOR  action  =  "delete"  TO  PRINT 
CLOSE  DATABASES 
DELETE  FILE  DREPORT. DBF 
USE  6cOUTFILE 

REPORT  FORM  AUGPRPT.FRM  FOR  action  =  p  report  TO  PRINT 
REPORT  FORM  AUGRMVU.FRM  FOR  action  =  "remove  u"  TO  PRINT 
REPORT  FORM  AUGCHKDT.FRM  FOR  action  =  "check  date  TO 
PRINT 

REPORT  FORM  AUGEX.FRM  FOR  action  =  "excess"  TO  PRINT 
REPORT  FORM  AUGESTLV.FRM  FOR  action  =  "establish  level  TO 
PRINT 

REPORT  FORM  AUGUNK.FRM  FOR  action  =  "unknown"  TO  PRINT 
CASE  mnth_rpt  =  09 

SORT  ON  psm.nsn  FOR  ACTION  =  delete  TO  DREPORT 
USE  DREPORT 

REPORT  FORM  SEPDEL.FRM  FOR  action  =  "delete  TO  PRINT 
CLOSE  DATABASES 
DELETE  FILE  DREPORT. DBF 
USE  icOUTFILE 

REPORT  FORM  SEPPRPT.FRM  FOR  action  =  ”p  report”  TO  PRINT 
REPORT  FORM  SEPRMVU.FRM  FOR  action  =  remove  u  TO  PRINT 
REPORT  FORM  SEPCHKDT.FRM  FOR  action  =  check  date  TO  PRINT 
REPORT  FORM  SEPEX.FRM  FOR  action  =  excess  TO  PRINT 
REPORT  FORM  SEPESTLV.FRM  FOR  action  =  "establish  level  TO 
PRINT 

REPORT  FORM  SEPUNK.FRM  FOR  action  =  "unknown"  TO  PRINT 
CASE  mnth_rpt  =  10 

SORT  ON  psm.nsn  FOR  ACTION  =  "delete"  TO  DREPORT 
USE  DREPORT 

REPORT  FORM  OCTDEL.FRM  FOR  action  =  delete  TO  PRINT 
CLOSE  DATABASES 
DELETE  FILE  DREPORT. DBF 
USE  &OUTFILE 

REPORT  FORM  OCTPRPT.FRM  FOR  action  =  p  report"  TO  PRINT 
REPORT  FORM  OCTRMVU.FRM  FOR  action  =  remove  u  TO  PRINT 
REPORT  FORM  OCTCHKDT.FRM  FOR  action  =  "check  date  TO 
PRINT 

REPORT  FORM  OCTEX.FRM  FOR  action  =  "excess"  TO  PRINT 
REPORT  FORM  OCTESTLV.FRM  FOR  action  =  establish  level  TO 
PRINT 

REPORT  FORM  OCTUNK.FRM  FOR  action  =  unknown  TO  PRINT 
CASE  mnth_rpt  =  11 

SORT  ON  psm.nsn  FOR  ACTION  =  "delete"  TO  DREPORT 
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USE  DREPORT 

REPORT  FORM  NOVDEL.FRM  FOR  action  =  "delete"  TO  PRINT 
CLOSE  DATABASES 
DELETE  FILE  DREPORT.DBF 
USE  icOUTFILE 

REPORT  FORM  NOVPRPT.FRM  FOR  action  =  "p  report'  TO  PRINT 
REPORT  FORM  NOVRMVU.FRM  FOR  action  =  "remove  u  TO  PRINT 
REPORT  FORM  NOVCHKDT.FRM  FOR  action  =  "check  date"  TO 
PRINT 

REPORT  FORM  NOVEX.FRM  FOR  action  =  "excess  TO  PRINT 
REPORT  FORM  NOVESTLV.FRM  FOR  action  =  "establish  level"  TO 
PRINT 

REPORT  FORM  NOVUNK.FRM  FOR  action  =  "unknown"  TO  PRINT 
CASE  mnth_rpt  =  12 

SORT  ON  psm.nsn  FOR  ACTION  =  "delete'  TO  DREPORT 
USE  DREPORT 

REPORT  FORM  DECDEL.FRM  FOR  action  =  "delete"  TO  PRINT 
CLOSE  DATABASES 
DELETE  FILE  DREPORT.DBF 
USE  ficOUTFILE 

REPORT  FORM  DECPRPT.FRM  FOR  action  =  p  report"  TO  PRINT 
REPORT  FORM  DECRMVU.FRM  FOR  action  =  remove  u  TO  PRINT 
REPORT  FORM  DECCHKDT.FRM  FOR  action  =  "check  date  TO 
PRINT 

REPORT  FORM  DECEX.FRM  FOR  action  =  "excess  TO  PRINT 
REPORT  FORM  DECESTLV.FRM  FOR  action  =  "establish  level'  TO 
PRINT 

REPORT  FORM  DECUNK.FRM  FOR  action  =  "unknown  TO  PRINT 
ENDCASE 
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Appendix  H:  Sample  Reports 


The  following  pages  contain  sample  reports  from  the  dBase  III+ 
version  of  the  expert  system.  The  raw  data  is  from  verification  data  set 
number  15.  If  there  were  no  decisions  for  a  particular  report,  only  the 
headings  for  that  report  were  printed. 
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Ittjnia  To  Be  Deleted 
Based  On  December  Leveling  Data 


A 


z  o  o  o 

R 


1-4  O  O  O 


O  o  o  o 
< 


CL  O  O  O 

Li4 

V) 


z 


orj 

or) 


a 


C 

o 

•J 

Ui 


«) 

oc 


o 


Lr> 

n 


o  o 


I'n  o 


£ 

% 


in 

o 


CO 

! 


O 

>o 


<N  O 


.-1  «•»  O 


W  rjN  D 

in 

'.*4 

cn  'O  -w 

o 

<3 

cS  -t 

o 

O 

X  O 

"T 

OH 

•H 

>  H 

i-n 

.■n 

ro 

<  CL 

(D 

C' 

in 

O 

o 

T 

00 

u 

in 

m 

o 

Q. 

•H 

*-< 

o 

o 

r4 

VI 

Z 

jij 

1-^ 

o  O 

$ 

u 

C  C4 

c 

a 

o 

fi 

5  '/>  I 

£ 

0  a.  'n 

z 

0 

f-.  <  a< 

X 

z 

Z  U  > 

p 

in  CJ  r- 

HO  '*‘4 

A 

C4  T 

Q 

fcH  T  "n 

g 

<0  T  m 

'N 

5 

^  iT  :''4 

:j 

— *  rg  -H 

a-H  -* 

— H 

0*0  '-/ 

c 

u 

3in  o 

o 

o 

^/)  3  T 

u 

•  m  -o 

'/> 

«  vO  o 

00 

177 


M-nthly  Stock  Status  Ropoit 


o 


•c  >•« 

m  c 

H  ® 

'j 

4> 

C 

*0 

<P 

in 

<0 

m 


o 

o 

< 


a. 

Ci] 


§ 


> 

o 

z 


cn 

tn 

t> 

•j 

& 

c  *J 

o  © 

U  OL 

u 


c  ^ 
0  © 
•J  > 


e 

c- 

o 


Z 

U 


w  'T' t) 
<n  -p  w 
CH  'tj 

X  C 

O  H 
>  -J 
<  a. 

© 

u 


<> 

o 

o 

■7' 


r- 


> 

<■/) 


e 


<  r- 

Q.  O 


»M  » 
© 

T 

^  u*> 
Ql.00 

§•2 

f/)  o 


17S 


McintMy  Stock  Status  k«port 


z 


8 


o 

< 


a. 

OJ 

VI 


> 

O 

z 


•J) 

If) 

<0 


o  ® 

u  «x 

UJ 


(J  rtU 

<  w 

^<3 

'7' 


ki  it) 
’©  > 

< 

u 

V  V 
e  jj 

V  tz 

V  €> 

rH  f.> 

£S 

O  V 
H  © 


C  ^ 

o  © 
u  > 

“J3 


2 

8 


tSS 

z 

•J 


'T'  © 
in  n  *.• 
-•  UJ 

X  a 

O  H 
>  U 
<  a. 

© 

u 


i 


o 

z 


o 


CD  04 

o  ■- 
<  r- 
a  o 


u 

o 

»/) 


179 


Remove  U  On  Following  Iteni3 
ised  On  OecetiiMr  Leveling  Data 


Z  CO 

B 


o 


^  o 


O  o  o 

o 

< 


Cl  O  O 

Cii 

to 


H  CO  iN 

s 


>  ^  o 

o 

z 


53 


4 


<2  c  c-i  'O 
6 


01 

D 

'j 

U] 
C  V 

o  © 
o  cx: 
u 


o 


o 


C  ^  'O  n* 

0  ©  CO  W 

^2 


•w 

cr>  © 

m 

cn 

©  V 

o 

o 

CD  © 

o 

o 

z 

o 

‘T 

S 

in 

<N 

O  '> 

z 

«<  > 

o.  o 


©  g 

O 

z 

M  (2 

3  ■< 

z 

v  H 

ro 

© 

-< 

>-•  z 

3t  „ 

rj  l-l 

C  X  to 

Z  5 

fi  Q  o 

QC 

S  O  o 

u]  O 

o  >-»  o 

Q.  ty 

Z  Q  W 

to  Z 

V4  m 

in 

U 

S 

o 

3  m 

■•3- 

z  ^ 

'T' 

» 

M  O 

-1 

u  m 

m 

o  o 

0 

V  in 

U"' 

o 

0 

180 


z  ^  ^  a  0*4  o 


wj 

R 

V 

O 

o 

o 

o 

O 

o 

o 

o 

< 

a. 

cn 

o 

ip 

o 

o 

UJ 

OCT  S 

o 

ui 

o 

o 

> 

o 

o 

z 

iS  4«< 

o 

o 

o 

o 

o 

Q  c 

o 

o 

o 

o 

o 

5^ 

in 

o 

o 

o 

o 

o 

in 

« 

u 

C  V 

Cl 

o 

o 

o 

0  ■© 

U  QC 

cu 

c  --< 

<7' 

o 

r- 

0  « 

'D 

CP 

Cl 

C4 

u  > 

UJ  <0 

(H  -w 

4m> 

£  j35 

V  a 

1 

T 

r* 

OJ 

r> 

CP 

Cij 

—4 

■t 

a 

GC 

<7*-^ 

o 

c  ^ 

m 

>  > 

5JS 

J  J 

r~ 

r»> 

00 

P 

% 

«-4 

i-^ 

e-<  fJ 

'A 

0  V- 
bL.  V 

g 

-  '3 

U 

O 

<§  ® 

fiP 

-4 

w 

'J 

V) 

■V  9 

s  ^ 

4J  U 

>. 

■*3 

V  'T'  C 

r? 

•i» 

n 

00 

TO 

Q  C 

7)  iS  w 

«— t 

o 

o 

o 

O 

O 

Ca  <5 

•o 

o 

C' 

<7^ 

P 

*-• 

I  a 

00 

00 

00 

TO 

C 

u  -0 

a 

«0  V 

U3 

U 

r 

z 

a. 

'> 

u. 

C; 

M4 

CO 

i-J 

»->4 

i2 

V 

O 

r/) 

< 

u 

H 

CQ 

> 

3 

z  c- 

< 

Z 

UJ 

4J 

af 

2  -w* 

on 

H 

e 

CQ 

> 

l-» 

Z  CO 

-< 

p  — < 

u 

c 

u.  S 

O  o 

><  cn 
>  N 

J 
ui  o 

U  O' 

<  1 

s 

X  ^ 

»-<« 

Pa: 

p  i-» 

O' 

P  a 

fc  ^ 

H4  P 

^  -» 

O  Cl 

3 

I-*  -< 

z  Z 

X  U]  >o 

cu  a. 

O  Cl 

z 

z  fj 

7  a.  uo 

a:  v> 

Ou  O 

’4^’ 

X 

u 

-T 

X 

t* 

.v 

<■0 

04 

T 

<> 

j2 

7 

7 

'T 

p 

g 

7 

00 

T 

o 

•xl 

uo 

O 

o 

O 

2 

O 

■7 

o 

Z  '- 

O 

'» 

z 

o 

o 

o 

Z3 

Cl]  <\ 

u 

CP 

CP 

IP 

IP 

p 

'O  •- 

0 

O 

o 

o 

<  C' 

V 

u"^ 

u't 

o'- 

uo 

p 

Ou  O 

fA 

>o 

>40 

181 


It^inis  To  ExcasboU 
based  On  C>ecen:jt‘ei  Lovolirn^  Data 


Monthly  Stock  Status  Report 


Items  With  Unknown  Action 
Based  On  December  Leveling  Data 


1-1 


a. 

b3 


s 


§ 


tn 

VI 

u 


a 


o 

u 

Cd 


ck: 


C 

O  <0 
o  > 


wJ  wJ 

z 


>  fD  U 
I  'ii  M 


5 


os- 

>  ij 

<  a. 


u 

£ 


O  '7- 
z  ^ 

<r> 

CD  C4 
O 

<  r- 
a  o 


u 


Z 

u 

o 

•M 


184 


Bibliography 

1.  Barr,  Avron  and  Edward  A.  Feigenbaum.  The  H^ndbwk  of  Artificial 

Intelligence.  Stanford  CA:  Heuristic  Press.  1981. 

2.  Demers.  W.  A.  “Too  Many  Spares.”  Military  Forum.  S-t0-b4  (March 

1989). 

3.  - .  “Warehouses;  Room  for  Improvement,”  Military  Forum.  6- 16-17 

(October  1989). 

•4.  Department  of  the  Air  Force.  Standard  Base  Supply  System.  AFM  67-1. 
Vol  V.  Government  Printing  Office.  Washington  DC:  1988. 

5.  Descartes,  Rene.  Rules  For  the  Direction  of  Mind. 

Britannica.  edited  by  T.  L.  Heath.  1952. 

6.  Emory.  William  C.  Business  Research  Methods.  Homewood  IL.  Irwin, 

1985. 

7.  Freiling,  Mike,  and  others.  “Starting  a  Knowledge  Engineering  Project;  A 

Step-by-Step  Approach."  A I  Magazine.  6- 150-164  (Fall  1985). 

8.  Gallon  T.  Quality^  Assurance  Quality  Control  in  Construction:  Expert 
Systems  Development  for  Multi/et  el  Experienced  Users.  Champaign  IL 
U.S.  Army  Construction  Engineering  Research  Laboratory,  Jan  1989  ( AD- 
A204520/1). 

9.  Gevarter,  W'illiam  B.  Intelligent  Machines:  An  Introiiucrory  Perspective 

of  Artificial  Intelligence  and  Robotics.  Englewood  Cliffs  NJ:  Prentice- 
Hall,  Inc.,  1985. 

10.  Harris.  Larry  R.  "Integration  With  Existing  Systems  Is  Key." 

Datamation.  JlfS,  40— 14  (March  1990). 

11.  Hicks.  Richard  and  Ronald  Lee,  VP-Expert  for  Business  Applications. 
Oakland  CA:  Holden-Day.  Inc.,  1988. 

12.  Holt.  James  R.  Class  lecture  in  EENG  593.  Systems  and  Software 

Analysis.  School  of  Systems  and  Logistics.  Air  Force  Institute  of 
Technology  (AU).  Wright-Patterson  AFB  OH,  Aug  1990. 

13.  O’Keefe,  Robert  M.  et  al..  Validating  Expert  System  Performance." 

IEEE  Expert.  (Winter  1987). 

14  Pearl.  Judea.  Heuristics  Intelligent  Search  Strategies  for  Computer 

Problem  Solving.  Reading  M.\;  Addison-W’esley  Publishing  Co..  1984 

15.  Pederson,  Ken.  Expert  Systems  Programming:  Practical  Techniques  for 
Rule-Based  Systems.  New  York;  John  Wiley  St  Sons,  Inc  .  1989. 


185 


16.  Pereira,  F.  Candide:  An  Interactive  System  for  the  Acquisition  of 

Domain  Specific  Knowledge.  7  September  1984-31  January  1988. 

Contract  No;  39-84-C-0109.  Menlo  Park  CA.  SRI  International.  May  1988 
(AD- A 196646/6). 

17.  Polya.  G.  How  to  Solve  It  -  A  Aspect  of  Mathematical  Method. 

Princeton  NJ:  Princeton  University  Press,  1985. 

IS.  Reitman,  Walter  R.  Cognition  and  Thought  An  Information-Processing 
Approach.  New  York:  John  Wiley  &.  Sons.  Inc..  1965. 

19.  Rescher.  Nicholas.  The  Logic  of  Decision  and  Action.  Pittsburgh; 
University  of  Pittsburgh  Press,  1966. 

20.  Schoen,  Seymour  and  William  G.  Sykes.  Putting  Artificial  Intelligence  ro 

Work:  Evaluating  and  Implementing  Business  Applications.  New  York: 
John  Wiley  U  Sons,  Inc.,  19S7. 

21.  Shaw.  M.J.  "Applying  Inductive  Learning  to  Enhance  Knowledge-Based 

Expert  Systems."  Decision  Support  Svstems.  J.  319-332  (December 
1987). 

22.  Siegel,  Harry  M.  "From  the  Chair.”  The  Inference  Engine,  2:  \  .(Dec 

1990). 

23.  Simon.  Herbert  A.  The  Sciences  of  the  Artificial  Cambridge  M  A:  The 

MIT  Press,  1981. 

24.  Survey  Research  Center  Institute  for  Social  Research.  Inren  iewer  s 

Manual.  Ann  Arbor:  The  University  of  Michigan.  1976. 


% 


186 


Vita 


Captain  Thomas  G.  Hibson  was  born  on  20  May  1959  in  Warwick,  Rhode 
Island.  He  graduated  from  Shrewsbury  High  School  in  Shrewsbury. 
Massachusetts  in  1977  and  attended  St.  Lawrence  University  graduating  with 
a  Bachelor  of  Science  degree  in  chemistry  in  19S1.  After  graduation  he 
worked  as  an  inorganic  chemist  for  GCA  Corporation  in  Bedford, 
Massachusetts  where  he  performed  numerous  chemical  analyses  to  determine 
hazardous  concentrations  of  heavy  metals  in  environmental  samples.  He  left 
GCA  Corp.  in  the  spring  of  1983  to  pursue  a  Master  of  Science  Degree  in 
computer  science  from  Worcester  Polytechnic  Institute  in  Worcester 
Massachusetts.  In  March  1985.  he  received  his  commission  in  the  USAF  as  a 
graduate  of  OTS.  His  first  assignment  was  as  a  Munitions  Accountable 
Supply  Officer  (MASO)  with  the  3098th  Aviation  Depot  Squadron  at  Kirtland 
AFB.  New  Mexico.  He  was  reassigned  as  the  Dedicated  Aircraft  Supply 
Support  (DASS)  Officer  at  Bitburg  AB.  Germany  in  April  1987.  While  in 
this  position,  he  completed  a  Master  of  Science  Degree  in  Management  with 
Troy  State  University  European  Program  in  October  1988.  In  October  1988 
he  was  assigned  as  the  Base  Fuels  Management  Officer  until  entering  the 
School  of  Systems  and  Logistics.  Air  Force  Institute  of  Technology,  in  May 
1990. 


Permanent  Address:  109  Prospect  Street 

Shrewsbury,  MA  01595 


187 


REPORT  DOCUMENTATION  PAGE 


Form  Approved 
0MB  No  0704-0188 


^uoJic  ''eoo'^!''o  Cufden  *or  t^is  .c'lecT'Cn  .:t  nToffr>^tiOn  -s  to  a«eraqe  ’  ■'Our  oer  '“soo^se  •'r’cdinq  the  time  fOf  rfv.ewmq  instruction^,  searcninq  e*istinq  data  sources, 

gathering  and  maif'taininq  tne  data  needed,  ana  corro  etinq  ano  revie-Ainq  tne  ji^iiention  ot  -ntofmation  ><»nd  comments  rAgardinq  this  burden  estimate  or  any  nher  asoect  ot  tnis 
collection  ,:f  .ntnfmaticn  nciudmg  suggestions  tor  reducing  rn.s  ouraen  to  A’ash'nqfon  neadauarters  Services  Dtreao'^re  tor  ntormaiion  Ooe'^ations  anq  fi<»Dorts.  12  jetterson 
Davis  H'Oh«vav  Sw'te  ’  2C4  ^ringtcn  /A  22202-4302  and  to  the  0»*i' e  .»  Manager^e^t  aro  budget  Heduction  Project '0704  0t88),  A-ashington  DC  20503 


1.  AGENCY  USE  ONLY  (Leave  blank) 


4.  TITLE  AND  SUBTITLE 


2.  REPORT  DATE 

Seo  tern  ber  1  991 


3.  REPORT  TYPE  AND  DATES  COVERED 

Master  3  Thesis 


htURiJTlCS  FOP  HOSPITAL  iNVENTORV  MANAGEMENT 


6.  AUTHOR(S) 

Thomas G,  Hibson,  Capt.USAF 


7.  PERFORMING  ORGANIZATION  NAME(S)  AND  AOORESS(ES) 

Air  Force  nstitote  ot  Technology.  WPAFB  Oh  45-433-65A3 


8.  PERFORIVIING  ORGANIZATION 
REPORT  NUMBER 


AF|T;,,^-  l  liM;  V  •  D 


9.  SPONSORING/MONITORING  A  iENCY  NAME(S)  AND  AOORESS(ES) 

•'■•'ign’- Patterson  Meaicai  Center/SGLS 
wr'cnt-Patterson  AF5  OH  45433 


10.  SPONSORING  /  MONITORING 
AGENCY  REPORT  NUMBER 


12a.  DISTRIBUTION/ AVAILABILITY  STATEMENT 


12b.  DISTRIBUTION  CODE 


1  -  -  ^  P.l 


■'e^eace.  aist^'^Dution  unlimitec! 


II.  ABSTRACT  (Maximum  200  words) 

"'ns  ctoc/  investigated  the  reasoning  stnategies  used  by  riospital  logistics  management  expsn’c  an: 
Aas  conGucted  at  the  Wngnt-Patterson  AFB'(  WPaFB  )  Medical  Center  An  expert  svstem  was 
gevelcbed  to  venty  the  captured  strategies.  The  particular  area  of  inters-st  of  this  stuct/  was  the 
reasoning  strategies  involvec  in  the  reconciliation  of  the  Monthly  Stocx  Status  Pepon  witnin  tne 
Medical  Log:  sties  Branch  A  literature  '■eview  revealed  there  were  few  guidel mes  as  to  .vhen  arc 
what  action  to  pursue  when  reconciling  the  Monthly  StocK  Status  Report  Trough  there  were  no 
'eterences  m  the  'iteratureon  expert  systems  that  dealt  with  this  particular  report,  the:  e  were 
manv  references  '.o  the  development  of  such  an  expert  system.  The  research  was  'fore  'n  three 
Phases  ne  fir  st  pnase  w.as  knowledge  acquisition  wnicn  is  xvhen  the  researcher  nterviewec  ‘oe 
expert  and  did  the  initial  formulation  of  the  reasoning  strateej/  During  tne  secord  ph.ase,  me 
researcher  developed  an  expert  system  whjch  was  then  validated  m  the  m,;rd  p''.:se  T.'s 
.alidation  revealed  the  expert  s'vstem  m-ade  the  same  decision  as  the  human  exrert  over  P  ct 


■:aph.jrad 


le  in  ‘he  vaiidation  data  sets  it  was  thereforeconcluded  tne  reasonin,]  strategies  we^t 


14.  SUBJECT  TERMS 

t“ied!cal  Computer  Applications 
Artificial  intelligence 
Logistics  Management  _ 


17.  SECURITY  CLASSIFICATION  18  SECURITY  CLASSIFICATION 

Urf?1aSWl?3“‘ 


19  SECURITY  CLASSIFICATION 

, ,  OF  abstract 

Unci  ass  Hied 


15.  NUMBER  OF  PAGES 


16  PRICE  CODE 


20  LIMITATION  OF  ABSTRACT 


MSN  7540-01 -ZSO-SSOO 


Standard  i^orm  798  iPev  2  89) 

L7'<‘sr.f  cy*<3  Dv  4NS>  MO 
248-02 


AFIT  Control  Number  afit/glm/lsm/91s-29 


AFIT  RESEARCH  ASSESSMENT 


The  purpose  of  this  questionnaire  is  to  determine  the  potential  for  cur¬ 
rent  and  future  applications  of  AFIT  thesis  research.  Please  return 
completed  questionnaires  to;  AFIT/LSC*  Wright-Patterson  AFB  OH 
45433-6583. 

1.  Did  this  research  contribute  to  a  current  research  project? 
a.  Yes  b.  No 


2.  Do  you  believe  this  research  topic  is  significant  enough  that  it  would 
have  been  researched  (or  contracted)  by  your  organization  or  another 
agency  if  AFIT  had  not  researched  it? 

a.  Yes  b.  No 


3.  The  benefits  of  AFIT  research  can  often  be  expressed  by  the  equivalent 
value  that  your  agency  received  by  virtue  of  AFIT  performing  the  research. 
Please  estimate  what  this  research  would  have  cost  in  terms  of  manpower 
and/or  dollars  if  it  had  been  accomplished  under  contract  or  if  it  had 
been  done  in-house. 

Man  Years  $ _ 


4.  Often  it  is  not  possible  to  attach  equivalent  dollar  values  to 
research,  although  the  results  of  the  research  may,  in  fact,  be  important. 
Whether  or  not  you  were  able  to  establish  an  equivalent  value  for  this 
research  (3  above),  what  is  your  estimate  of  its  significance? 

a.  Highly  b.  Significant  c.  Slightly  d.  Of  No 

Significant  Significant  Significance 


5.  Comments 


